Jul 06 09:58:22 devstack cinder-volume[75345]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 09:58:22 devstack cinder-volume[75345]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 09:58:22 devstack cinder-volume[75345]: we strongly recommend against using it for new projects. Jul 06 09:58:22 devstack cinder-volume[75345]: If you are already using Eventlet, we recommend migrating to a different Jul 06 09:58:22 devstack cinder-volume[75345]: framework. For more detail see Jul 06 09:58:22 devstack cinder-volume[75345]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 09:58:22 devstack cinder-volume[75345]: import eventlet # noqa Jul 06 09:58:25 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 09:58:25 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 09:58:25 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 09:58:26 devstack cinder-volume[75345]: INFO dbcounter [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Registered counter for database cinder Jul 06 09:58:26 devstack cinder-volume[75345]: DEBUG oslo_db.sqlalchemy.engines [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 09:58:26 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writer thread running {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 09:58:26 devstack cinder-volume[75345]: INFO cinder.rpc [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 09:58:26 devstack cinder-volume[75345]: INFO cinder.rpc [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_db.sqlalchemy.engines [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 09:58:27 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Determined volume DB was empty at startup. Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG cinder.volume.manager [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75345) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 09:58:27 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 09:58:27 devstack cinder-volume[75345]: WARNING stevedore.named [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 09:58:27 devstack cinder-volume[75345]: WARNING castellan.key_manager [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 09:58:27 devstack cinder-volume[75345]: WARNING cinder.keymgr.conf_key_mgr [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG cinder.volume.drivers.lvm [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75345) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_concurrency.processutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] CMD "cinder-rtstool verify" returned: 0 in 0.380s {{(pid=75345) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_db.sqlalchemy.engines [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 09:58:27 devstack cinder-volume[75345]: INFO cinder.rpc [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 09:58:27 devstack cinder-volume[75345]: INFO cinder.rpc [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 09:58:27 devstack cinder-volume[75345]: WARNING stevedore.named [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 09:58:27 devstack cinder-volume[75345]: WARNING castellan.key_manager [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 09:58:27 devstack cinder-volume[75345]: INFO cinder.volume.manager [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_db.sqlalchemy.engines [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75345) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 09:58:27 devstack cinder-volume[75345]: INFO oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Starting 1 workers Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Started child 75515 {{(pid=75345) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Full set of CONF: {{(pid=75345) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] ******************************************************************************** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Configuration options gathered from: {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] ================================================================================ {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] allow_availability_zone_fallback = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] allow_compression_on_image_upload = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] allowed_direct_url_schemes = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] api_rate_limit = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] auth_strategy = keystone {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] az_cache_duration = 3600 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_availability_zone = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_host = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_stats_polling_interval = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backup_api_class = cinder.backup.api.API {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75515]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backup_name_template = backup-%s {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backup_use_same_host = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backup_use_temp_snapshot = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] chap_password = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] chap_username = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_internal_tenant_project_id = 1c0d6ebaf8e14f09b3c66de55d38ddd3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_internal_tenant_user_id = a52fcf7ca07a4dada95c56ea329d782f {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cloned_volume_same_az = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cluster = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] compression_format = gzip {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] compute_api_class = cinder.compute.nova.API {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] config_dir = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] config_source = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] control_exchange = openstack {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] debug = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] default_availability_zone = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] default_group_type = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] default_volume_type = lvmdriver-1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] disk_geometry = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] driver_client_cert = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] driver_client_cert_key = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] driver_data_namespace = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] driver_ssl_cert_path = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] driver_ssl_cert_verify = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] driver_use_ssl = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] enable_force_upload = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] enable_new_services = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] enable_unsupported_driver = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] enforce_multipath_for_image_xfer = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] filter_function = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_api_insecure = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_api_servers = ['http://192.168.122.191/image'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_api_ssl_compression = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_ca_certificates_file = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_catalog_info = image:glance:publicURL {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_num_retries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance_request_timeout = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] goodness_function = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] graceful_shutdown_timeout = 5 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] group_api_class = cinder.group.api.API {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] host = devstack {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_compress_on_upload = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_conversion_address_space_limit = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_conversion_cpu_limit = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_conversion_disable = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_upload_use_cinder_backend = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_upload_use_internal_tenant = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_volume_cache_enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_volume_cache_max_count = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] image_volume_cache_max_size_gb = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] init_host_max_objects_retrieval = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] instance_format = [instance: %(uuid)s] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] iscsi_target_flags = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] iscsi_write_cache = on {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] iser_helper = tgtadm {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] iser_ip_address = 192.168.122.191 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] iser_port = 3260 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_color = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_config_append = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_dir = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_file = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_options = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_rotate_interval = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_rotate_interval_type = days {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] log_rotation_type = none {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75515]: INFO cinder.volume.manager [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] max_age = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] max_logfile_count = 30 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] max_logfile_size_mb = 200 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] max_over_subscription_ratio = 20.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] message_reap_interval = 86400 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] message_ttl = 2592000 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] migration_create_volume_timeout_secs = 300 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] monkey_patch = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] monkey_patch_modules = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] my_ip = 192.168.122.191 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] no_snapshot_gb_quota = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] num_iser_scan_tries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] num_shell_tries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] num_volume_device_scan_tries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] nvmeof_conn_info_version = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] nvmet_ns_id = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] nvmet_port_id = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] osapi_max_limit = 1000 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] osapi_volume_ext_list = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] osapi_volume_listen_port = 8776 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] osapi_volume_use_ssl = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] osapi_volume_workers = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] per_volume_size_limit = -1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] periodic_fuzzy_delay = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] periodic_interval = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] public_endpoint = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] publish_errors = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] quota_backup_gigabytes = 1000 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] quota_backups = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] quota_gigabytes = 1000 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] quota_groups = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] quota_snapshots = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] quota_volumes = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] rate_limit_burst = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] rate_limit_except_level = CRITICAL {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] rate_limit_interval = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] reinit_driver_count = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] replication_device = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] report_discard_supported = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] report_interval = 120 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] reservation_clean_interval = 86400 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] reservation_expire = 86400 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] reserved_image_namespaces = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] reserved_percentage = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] rpc_response_timeout = 120 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] run_external_periodic_tasks = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] scst_target_driver = iscsi {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] scst_target_iqn_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_down_time = 720 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] shell_completion = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] snapshot_name_template = snapshot-%s {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] snapshot_same_host = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] split_loggers = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] state_path = /opt/stack/data/cinder {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] storage_availability_zone = nova {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] storage_protocol = iSCSI {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] syslog_log_facility = LOG_USER {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] target_helper = lioadm {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] target_ip_address = 192.168.122.191 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] target_port = 3260 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] target_protocol = iscsi {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] target_secondary_ip_addresses = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] trace_flags = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] transport_url = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] until_refresh = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] use_chap_auth = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] use_default_quota_class = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] use_journal = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] use_json = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] use_multipath_for_image_xfer = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] use_stderr = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] use_syslog = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] verify_glance_signatures = enabled {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_api_class = cinder.volume.api.API {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_backend_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_clear = zero {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_clear_ionice = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_clear_size = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_copy_bps_limit = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_dd_blocksize = 1M {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_name_template = volume-%s {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_service_inithost_offload = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volume_usage_audit_period = month {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] zoning_mode = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_concurrency.disable_process_locking = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.auth_section = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.auth_type = password {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.auth_version = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.cache = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.include_service_catalog = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.insecure = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.interface = public {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_password = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcache_username = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.region_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.service_type = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.191/identity {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.backend = dogpile.cache.null {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.backend_argument = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.backend_expiration_time = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.config_prefix = cache.oslo {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.debug_cache_backend = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.enable_retry_client = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.enable_socket_keepalive = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.expiration_time = 600 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.hashclient_retry_attempts = 2 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.memcache_dead_retry = 300 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.memcache_pool_maxsize = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.memcache_sasl_enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.password = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.proxies = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.redis_db = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.redis_server = localhost:6379 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.retry_attempts = 2 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.retry_delay = 0.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.socket_keepalive_count = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.socket_keepalive_idle = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.socket_keepalive_interval = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.socket_timeout = 1.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.tls_allowed_ciphers = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.tls_cafile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.tls_certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.tls_enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.tls_keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cache.username = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] coordination.backend_url = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.asyncio_connection = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.asyncio_slave_connection = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.backend = sqlalchemy {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.connection = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.connection_debug = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.connection_parameters = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.connection_recycle_time = 3600 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.connection_trace = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.db_inc_retry_interval = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.db_max_retries = 20 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.db_max_retry_interval = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.db_retry_interval = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.max_overflow = 50 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.max_pool_size = 5 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.max_retries = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.mysql_wsrep_sync_wait = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.pool_timeout = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.retry_interval = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.slave_connection = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.sqlite_synchronous = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.synchronous_reader = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] database.use_db_reconnect = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.connection_string = messaging:// {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.es_doc_type = notification {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.es_scroll_size = 10000 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.es_scroll_time = 2m {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.filter_error_trace = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.hmac_keys = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.sentinel_service_name = mymaster {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.socket_timeout = 0.1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.trace_requests = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler.trace_sqlalchemy = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler_jaeger.process_tags = {} {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler_jaeger.service_name_prefix = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] profiler_otlp.service_name_prefix = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.enforce_new_defaults = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.enforce_scope = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.policy_default_rule = default {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.policy_file = policy.yaml {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] privsep_osbrick.group = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] privsep_osbrick.helper_command = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] privsep_osbrick.user = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_sys_admin.group = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_sys_admin.helper_command = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] cinder_sys_admin.user = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.auth_section = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.auth_type = password {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.cafile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.collect_timing = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.insecure = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.send_service_user_token = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.split_loggers = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] service_user.timeout = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.auth_section = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.auth_type = password {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.collect_timing = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.insecure = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack sudo[75520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 09:58:27 devstack sudo[75520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.region_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.split_loggers = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] glance.timeout = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.backend_availability_zone = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.chap_password = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.chap_username = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.disk_geometry = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.driver_client_cert = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.driver_client_cert_key = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.driver_data_namespace = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.driver_use_ssl = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.extra_capabilities = {} {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.filter_function = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.goodness_function = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.iscsi_target_flags = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.iscsi_write_cache = on {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.iser_helper = tgtadm {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.iser_ip_address = 192.168.122.191 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.iser_port = 3260 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.lvm_share_target = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.lvm_type = auto {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.num_shell_tries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.replication_device = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.report_discard_supported = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.reserved_percentage = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.target_helper = tgtadm {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:27 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.target_ip_address = 192.168.122.191 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.target_port = 3260 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.target_protocol = iscsi {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.trace_flags = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.unique_fqdn_network = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.use_chap_auth = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_backend_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_clear = zero {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_clear_ionice = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_clear_size = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_reports.file_event_handler = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_reports.log_dir = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.backend_host = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.chap_password = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.chap_username = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.disk_geometry = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.driver_client_cert = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.extra_capabilities = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.filter_function = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.goodness_function = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.iser_helper = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.iser_ip_address = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.iser_port = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.lvm_share_target = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.lvm_type = auto {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.num_shell_tries = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.replication_device = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.report_discard_supported = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.reserved_percentage = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.scst_target_driver = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.storage_protocol = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.target_helper = lioadm {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.target_ip_address = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.target_port = 3260 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.trace_flags = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.use_chap_auth = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_clear = zero {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_clear_size = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] lvmdriver-1.volumes_dir = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.ssl = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_notifications.driver = [] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_notifications.retry = -1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] key_manager.fixed_key = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.barbican_api_version = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.barbican_endpoint = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.barbican_endpoint_type = public {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.barbican_region_name = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.cafile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.collect_timing = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.insecure = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.number_of_retries = 60 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.retry_delay = 1 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.send_service_user_token = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.split_loggers = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.timeout = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.verify_ssl = True {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican.verify_ssl_path = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.auth_section = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.auth_type = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.cafile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.certfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.collect_timing = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.insecure = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.keyfile = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.split_loggers = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] barbican_service_user.timeout = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.approle_role_id = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.approle_secret_id = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.kv_mountpoint = secret {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.kv_path = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.kv_version = 2 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.namespace = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.root_token_id = **** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.ssl_ca_crt_file = None {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.timeout = 60.0 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.use_ssl = False {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 09:58:28 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] ******************************************************************************** {{(pid=75345) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 09:58:28 devstack sudo[75520]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:28 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:28 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:28 devstack sudo[75689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:28 devstack sudo[75689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:29 devstack sudo[75689]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:29 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.707s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:29 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 09:58:29 devstack cinder-volume[75515]: INFO cinder.brick.local_dev.lvm [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 09:58:29 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:29 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:29 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:29 devstack sudo[75930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 09:58:29 devstack sudo[75930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:30 devstack sudo[75930]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:30 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:30 devstack cinder-volume[75515]: DEBUG cinder.brick.local_dev.lvm [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75515) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 09:58:30 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:30 devstack sudo[76092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:30 devstack sudo[76092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:31 devstack sudo[76092]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:31 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.163s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:31 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:31 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:31 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:31 devstack sudo[76299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:31 devstack sudo[76299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:32 devstack sudo[76299]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:32 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.714s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:32 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:32 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:32 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:32 devstack sudo[76304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 09:58:32 devstack sudo[76304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:32 devstack sudo[76304]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:32 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.817s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:32 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:32 devstack sudo[76308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 09:58:32 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:33 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:33 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.888s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:33 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:33 devstack sudo[76320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 09:58:33 devstack sudo[76320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:34 devstack sudo[76320]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:34 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.875s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:34 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:34 devstack sudo[76326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 09:58:34 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:35 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:35 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.763s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:35 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:35 devstack sudo[76333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:35 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:36 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:36 devstack sudo[76338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:36 devstack sudo[76338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:36 devstack sudo[76338]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.808s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:36 devstack cinder-volume[75515]: INFO cinder.volume.drivers.lvm [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:36 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:36 devstack sudo[76433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:36 devstack sudo[76433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:37 devstack sudo[76433]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:37 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.731s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:37 devstack cinder-volume[75515]: DEBUG cinder.volume.drivers.lvm [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Updating volume stats {{(pid=75515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 09:58:37 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:37 devstack sudo[76464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 09:58:37 devstack sudo[76464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:37 devstack cinder-volume[75345]: DEBUG dbcounter [-] [75345] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75345) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 09:58:38 devstack sudo[76464]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:38 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:38 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:38 devstack sudo[76608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 09:58:38 devstack sudo[76608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:38 devstack sudo[76608]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:38 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:38 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:38 devstack sudo[76611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:38 devstack sudo[76611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:39 devstack sudo[76611]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:39 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:39 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:39 devstack sudo[76614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 09:58:39 devstack sudo[76614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:40 devstack sudo[76614]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:40 devstack cinder-volume[75515]: INFO cinder.volume.driver [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG cinder.volume.driver [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75515) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG oslo_db.sqlalchemy.engines [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG dbcounter [-] [75515] Writer thread running {{(pid=75515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG cinder.db.api [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Building query based on filter {{(pid=75515) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG cinder.image.image_utils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75515) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 09:58:40 devstack cinder-volume[75515]: INFO cinder.keymgr.migration [None req-dba5bec3-022d-44a2-b897-3c401b4284e2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG cinder.volume.drivers.lvm [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Updating volume stats {{(pid=75515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 09:58:40 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:40 devstack sudo[76619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 09:58:40 devstack sudo[76619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:41 devstack sudo[76619]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:41 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:41 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:41 devstack sudo[76622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 09:58:41 devstack sudo[76622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:41 devstack sudo[76622]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:41 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.778s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:41 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:41 devstack sudo[76628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:41 devstack sudo[76628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:42 devstack sudo[76628]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:42 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.787s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:42 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:42 devstack sudo[76632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 09:58:42 devstack sudo[76632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:43 devstack sudo[76632]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:43 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:43 devstack cinder-volume[75515]: DEBUG cinder.manager [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Notifying Schedulers of capabilities ... {{(pid=75515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 09:58:43 devstack cinder-volume[75515]: INFO cinder.volume.manager [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Driver initialization completed successfully. Jul 06 09:58:43 devstack cinder-volume[75515]: INFO cinder.manager [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Initiating service 2 cleanup Jul 06 09:58:43 devstack cinder-volume[75515]: INFO cinder.manager [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Service 2 cleanup completed. Jul 06 09:58:43 devstack cinder-volume[75515]: DEBUG cinder.service [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Creating RPC server for service cinder-volume {{(pid=75515) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 09:58:43 devstack cinder-volume[75515]: DEBUG cinder.service [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75515) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 09:58:43 devstack cinder-volume[75515]: INFO cinder.volume.manager [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 09:58:43 devstack cinder-volume[75515]: DEBUG cinder.volume.drivers.lvm [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Updating volume stats {{(pid=75515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 09:58:43 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:43 devstack sudo[76636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 09:58:43 devstack sudo[76636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:44 devstack sudo[76636]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:44 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:44 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:44 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 09:58:44 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:44 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:44 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:44 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:44 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 09:58:44 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:45 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:45 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:45 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 09:58:45 devstack sudo[76702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 09:58:45 devstack sudo[76702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 09:58:46 devstack sudo[76702]: pam_unix(sudo:session): session closed for user root Jul 06 09:58:46 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 09:58:46 devstack cinder-volume[75515]: INFO cinder.volume.manager [None req-6fbb400c-8c40-4884-bbdf-1be92e93edf0 None None] Driver post RPC initialization completed successfully. Jul 06 09:58:56 devstack cinder-volume[75515]: DEBUG dbcounter [-] [75515] Writing DB stats cinder:SELECT=3 {{(pid=75515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 09:58:56 devstack cinder-volume[75515]: DEBUG dbcounter [-] [75515] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 09:59:04 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager._thread_info {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 09:59:04 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread count: 6 {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 09:59:04 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread info: [<_MainThread(MainThread, started 135790479405184)>, , , , , ] {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:00:04 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:00:04 devstack cinder-volume[75515]: DEBUG cinder.volume.drivers.lvm [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Updating volume stats {{(pid=75515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 10:00:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:00:04 devstack sudo[79050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 10:00:04 devstack sudo[79050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:00:04 devstack sudo[79050]: pam_unix(sudo:session): session closed for user root Jul 06 10:00:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:00:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:00:04 devstack sudo[79053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:00:04 devstack sudo[79053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:00:05 devstack sudo[79053]: pam_unix(sudo:session): session closed for user root Jul 06 10:00:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:00:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:00:05 devstack sudo[79056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 10:00:05 devstack sudo[79056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:00:06 devstack sudo[79056]: pam_unix(sudo:session): session closed for user root Jul 06 10:00:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.627s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:00:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:00:06 devstack sudo[79060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:00:06 devstack sudo[79060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:00:06 devstack sudo[79060]: pam_unix(sudo:session): session closed for user root Jul 06 10:00:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:00:06 devstack cinder-volume[75515]: DEBUG cinder.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Notifying Schedulers of capabilities ... {{(pid=75515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:00:06 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager._thread_info {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:00:06 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread count: 6 {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:00:06 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread info: [<_MainThread(MainThread, started 135790479405184)>, , , , , ] {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:00:56 devstack cinder-volume[75515]: DEBUG dbcounter [-] [75515] Writing DB stats cinder:SELECT=1 {{(pid=75515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:00:56 devstack cinder-volume[75515]: DEBUG dbcounter [-] [75515] Writing DB stats cinder:UPDATE=1 {{(pid=75515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:01:04 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:01:04 devstack cinder-volume[75515]: DEBUG cinder.volume.drivers.lvm [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Updating volume stats {{(pid=75515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 10:01:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:01:04 devstack sudo[82007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 10:01:04 devstack sudo[82007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:01:04 devstack sudo[82007]: pam_unix(sudo:session): session closed for user root Jul 06 10:01:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:01:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:01:04 devstack sudo[82020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:01:04 devstack sudo[82020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:01:05 devstack sudo[82020]: pam_unix(sudo:session): session closed for user root Jul 06 10:01:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:01:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:01:05 devstack sudo[82024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 10:01:05 devstack sudo[82024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:01:06 devstack sudo[82024]: pam_unix(sudo:session): session closed for user root Jul 06 10:01:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:01:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:01:06 devstack sudo[82040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:01:06 devstack sudo[82040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:01:06 devstack sudo[82040]: pam_unix(sudo:session): session closed for user root Jul 06 10:01:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:01:06 devstack cinder-volume[75515]: DEBUG cinder.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Notifying Schedulers of capabilities ... {{(pid=75515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:01:06 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager._thread_info {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:01:06 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread count: 6 {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:01:06 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread info: [<_MainThread(MainThread, started 135790479405184)>, , , , , ] {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:02:04 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:02:04 devstack cinder-volume[75515]: DEBUG cinder.volume.drivers.lvm [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Updating volume stats {{(pid=75515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 10:02:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:02:04 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 10:02:04 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:02:04 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Jul 06 10:02:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:02:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:02:04 devstack sudo[84022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:02:04 devstack sudo[84022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:02:05 devstack sudo[84022]: pam_unix(sudo:session): session closed for user root Jul 06 10:02:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.751s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:02:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:02:05 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 10:02:05 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:02:06 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Jul 06 10:02:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.763s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:02:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:02:06 devstack sudo[84073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:02:06 devstack sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:02:07 devstack sudo[84073]: pam_unix(sudo:session): session closed for user root Jul 06 10:02:07 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:02:07 devstack cinder-volume[75515]: DEBUG cinder.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Notifying Schedulers of capabilities ... {{(pid=75515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:02:56 devstack cinder-volume[75515]: DEBUG dbcounter [-] [75515] Writing DB stats cinder:SELECT=1 {{(pid=75515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:02:56 devstack cinder-volume[75515]: DEBUG dbcounter [-] [75515] Writing DB stats cinder:UPDATE=1 {{(pid=75515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:03:04 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:03:04 devstack cinder-volume[75515]: DEBUG cinder.volume.drivers.lvm [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Updating volume stats {{(pid=75515) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 10:03:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:04 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 10:03:04 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:04 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:04 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:04 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:03:04 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:05 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:05 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:05 devstack sudo[85182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 10:03:05 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:06 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:06 devstack sudo[85199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 10:03:06 devstack sudo[85199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:06 devstack sudo[85199]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:06 devstack cinder-volume[75515]: DEBUG oslo_concurrency.processutils [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:06 devstack cinder-volume[75515]: DEBUG cinder.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Notifying Schedulers of capabilities ... {{(pid=75515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:03:06 devstack cinder-volume[75515]: DEBUG oslo_service.periodic_task [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] Running periodic task VolumeManager._thread_info {{(pid=75515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:03:06 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread count: 6 {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:03:06 devstack cinder-volume[75515]: DEBUG cinder.volume.manager [None req-3b2b9179-b35c-42ff-b832-28f94681a8d0 None None] thread info: [<_MainThread(MainThread, started 135790479405184)>, , , , , ] {{(pid=75515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:03:23 devstack cinder-volume[75345]: INFO oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Caught SIGTERM, stopping children Jul 06 10:03:23 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Acquiring lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 10:03:23 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Acquired lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 10:03:23 devstack cinder-volume[75345]: DEBUG oslo_concurrency.lockutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Releasing lock "singleton_lock" {{(pid=75345) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 10:03:23 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Stop services. {{(pid=75345) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 10:03:23 devstack cinder-volume[75345]: DEBUG oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Killing children. {{(pid=75345) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 10:03:23 devstack cinder-volume[75345]: INFO oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Waiting on 1 children to exit Jul 06 10:03:23 devstack cinder-volume[75515]: DEBUG oslo_concurrency.lockutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Acquiring lock "singleton_lock" {{(pid=75515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 10:03:23 devstack cinder-volume[75515]: DEBUG oslo_concurrency.lockutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Acquired lock "singleton_lock" {{(pid=75515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 10:03:23 devstack cinder-volume[75515]: DEBUG oslo_concurrency.lockutils [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Releasing lock "singleton_lock" {{(pid=75515) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 10:03:23 devstack cinder-volume[75515]: WARNING amqp [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 10:03:23 devstack cinder-volume[75515]: WARNING amqp [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 10:03:23 devstack cinder-volume[75345]: INFO oslo_service.backend._eventlet.service [None req-b88902c7-2c87-4752-b70b-558f74c8da79 None None] Child 75515 exited with status 0 Jul 06 10:03:23 devstack cinder-volume[85657]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 10:03:23 devstack cinder-volume[85657]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 10:03:23 devstack cinder-volume[85657]: we strongly recommend against using it for new projects. Jul 06 10:03:23 devstack cinder-volume[85657]: If you are already using Eventlet, we recommend migrating to a different Jul 06 10:03:23 devstack cinder-volume[85657]: framework. For more detail see Jul 06 10:03:23 devstack cinder-volume[85657]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 10:03:23 devstack cinder-volume[85657]: import eventlet # noqa Jul 06 10:03:25 devstack cinder-volume[85657]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85657) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 10:03:25 devstack cinder-volume[85657]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85657) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 10:03:25 devstack cinder-volume[85657]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85657) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 10:03:26 devstack cinder-volume[85657]: INFO dbcounter [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Registered counter for database cinder Jul 06 10:03:26 devstack cinder-volume[85657]: DEBUG oslo_db.sqlalchemy.engines [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85657) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:26 devstack cinder-volume[85657]: DEBUG dbcounter [-] [85657] Writer thread running {{(pid=85657) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 10:03:26 devstack cinder-volume[85657]: INFO cinder.rpc [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 10:03:26 devstack cinder-volume[85657]: INFO cinder.rpc [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_db.sqlalchemy.engines [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85657) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:27 devstack cinder-volume[85657]: INFO cinder.volume.manager [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Determined volume DB was empty at startup. Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG cinder.volume.manager [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85657) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 10:03:27 devstack cinder-volume[85657]: INFO cinder.volume.manager [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 10:03:27 devstack cinder-volume[85657]: WARNING stevedore.named [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 10:03:27 devstack cinder-volume[85657]: WARNING castellan.key_manager [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 10:03:27 devstack cinder-volume[85657]: WARNING cinder.keymgr.conf_key_mgr [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 10:03:27 devstack cinder-volume[85657]: INFO cinder.volume.manager [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_db.sqlalchemy.engines [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85657) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:27 devstack cinder-volume[85657]: INFO oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Starting 1 workers Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Started child 85870 {{(pid=85657) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Full set of CONF: {{(pid=85657) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] ******************************************************************************** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Configuration options gathered from: {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] ================================================================================ {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] allow_availability_zone_fallback = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] allow_compression_on_image_upload = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85870]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] allowed_direct_url_schemes = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] api_rate_limit = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] auth_strategy = keystone {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_availability_zone = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_host = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_stats_polling_interval = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backup_api_class = cinder.backup.api.API {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backup_name_template = backup-%s {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backup_use_same_host = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backup_use_temp_snapshot = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] chap_password = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] chap_username = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_internal_tenant_project_id = 1c0d6ebaf8e14f09b3c66de55d38ddd3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_internal_tenant_user_id = a52fcf7ca07a4dada95c56ea329d782f {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cluster = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] compression_format = gzip {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] compute_api_class = cinder.compute.nova.API {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] config_dir = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] config_source = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] control_exchange = openstack {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] debug = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] default_availability_zone = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] default_group_type = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] default_volume_type = QuobyteHD {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] disk_geometry = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] driver_client_cert = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] driver_client_cert_key = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] driver_data_namespace = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] driver_ssl_cert_path = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] driver_ssl_cert_verify = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] driver_use_ssl = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] enable_new_services = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] enable_unsupported_driver = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] enabled_backends = ['QuobyteHD'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] enforce_multipath_for_image_xfer = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] filter_function = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_api_insecure = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_api_servers = ['http://192.168.122.191/image'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_api_ssl_compression = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_ca_certificates_file = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_catalog_info = image:glance:publicURL {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_num_retries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance_request_timeout = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] goodness_function = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] graceful_shutdown_timeout = 5 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] group_api_class = cinder.group.api.API {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] host = devstack {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_compress_on_upload = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_conversion_address_space_limit = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_conversion_cpu_limit = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_conversion_disable = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_upload_use_cinder_backend = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_upload_use_internal_tenant = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_volume_cache_enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_volume_cache_max_count = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] image_volume_cache_max_size_gb = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] init_host_max_objects_retrieval = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] instance_format = [instance: %(uuid)s] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] iscsi_target_flags = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] iscsi_write_cache = on {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] iser_helper = tgtadm {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] iser_ip_address = 192.168.122.191 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] iser_port = 3260 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_color = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_config_append = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_dir = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_file = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_options = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_rotate_interval = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_rotate_interval_type = days {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] log_rotation_type = none {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] max_age = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] max_logfile_count = 30 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] max_logfile_size_mb = 200 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] max_over_subscription_ratio = 20.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] message_reap_interval = 86400 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] message_ttl = 2592000 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] migration_create_volume_timeout_secs = 300 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] monkey_patch = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] monkey_patch_modules = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] my_ip = 192.168.122.191 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] no_snapshot_gb_quota = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] num_iser_scan_tries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] num_shell_tries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] num_volume_device_scan_tries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] nvmeof_conn_info_version = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] nvmet_ns_id = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.remotefs [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85870) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] nvmet_port_id = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] osapi_max_limit = 1000 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] osapi_volume_ext_list = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] osapi_volume_listen_port = 8776 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] osapi_volume_use_ssl = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] osapi_volume_workers = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] per_volume_size_limit = -1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] periodic_fuzzy_delay = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] periodic_interval = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] public_endpoint = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] publish_errors = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] quota_backup_gigabytes = 1000 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] quota_backups = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] quota_gigabytes = 1000 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] quota_groups = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] quota_snapshots = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] quota_volumes = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] rate_limit_burst = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] rate_limit_except_level = CRITICAL {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] rate_limit_interval = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] reinit_driver_count = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] replication_device = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] report_discard_supported = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] report_interval = 120 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] reservation_clean_interval = 86400 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] reservation_expire = 86400 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] reserved_image_namespaces = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] reserved_percentage = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] rpc_response_timeout = 120 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] run_external_periodic_tasks = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] scst_target_driver = iscsi {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] scst_target_iqn_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_down_time = 720 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] shell_completion = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] snapshot_name_template = snapshot-%s {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] split_loggers = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] state_path = /opt/stack/data/cinder {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] storage_availability_zone = nova {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] storage_protocol = iSCSI {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] syslog_log_facility = LOG_USER {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] target_helper = lioadm {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] target_ip_address = 192.168.122.191 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] target_port = 3260 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] target_protocol = iscsi {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] target_secondary_ip_addresses = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] trace_flags = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] transport_url = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] until_refresh = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] use_chap_auth = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] use_default_quota_class = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] use_journal = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] use_json = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] use_multipath_for_image_xfer = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] use_stderr = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] use_syslog = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] verify_glance_signatures = enabled {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_api_class = cinder.volume.api.API {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_backend_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_clear = zero {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_clear_ionice = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_clear_size = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_copy_bps_limit = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_dd_blocksize = 1M {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_name_template = volume-%s {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_service_inithost_offload = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volume_usage_audit_period = month {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] zoning_mode = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_concurrency.disable_process_locking = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.auth_section = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.auth_type = password {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.auth_version = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.cache = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.include_service_catalog = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.insecure = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.interface = public {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_password = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcache_username = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.region_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.service_type = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.191/identity {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.backend = dogpile.cache.null {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.backend_argument = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.backend_expiration_time = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.config_prefix = cache.oslo {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.debug_cache_backend = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.enable_retry_client = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.enable_socket_keepalive = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.expiration_time = 600 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.hashclient_retry_attempts = 2 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.memcache_dead_retry = 300 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.memcache_pool_maxsize = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.memcache_sasl_enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.password = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85870) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 10:03:27 devstack cinder-volume[85870]: WARNING cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 10:03:27 devstack cinder-volume[85870]: WARNING cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.proxies = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.redis_db = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Running cmd (subprocess): mount.quobyte {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.redis_server = localhost:6379 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.retry_attempts = 2 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.retry_delay = 0.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.socket_keepalive_count = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.socket_keepalive_idle = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.socket_keepalive_interval = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.socket_timeout = 1.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.tls_allowed_ciphers = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.tls_cafile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.tls_certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.tls_enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.tls_keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cache.username = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] coordination.backend_url = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.asyncio_connection = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.asyncio_slave_connection = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.backend = sqlalchemy {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.connection = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.connection_debug = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.connection_parameters = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.connection_recycle_time = 3600 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.connection_trace = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.db_inc_retry_interval = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.db_max_retries = 20 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.db_max_retry_interval = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.db_retry_interval = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.max_overflow = 50 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.max_pool_size = 5 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.max_retries = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.mysql_wsrep_sync_wait = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.pool_timeout = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.retry_interval = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.slave_connection = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.sqlite_synchronous = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.synchronous_reader = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] database.use_db_reconnect = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.connection_string = messaging:// {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.es_doc_type = notification {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.es_scroll_size = 10000 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.es_scroll_time = 2m {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.filter_error_trace = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.hmac_keys = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.sentinel_service_name = mymaster {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.socket_timeout = 0.1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.trace_requests = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler.trace_sqlalchemy = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler_jaeger.process_tags = {} {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler_jaeger.service_name_prefix = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] profiler_otlp.service_name_prefix = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.enforce_new_defaults = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.enforce_scope = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.policy_default_rule = default {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.policy_file = policy.yaml {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] privsep_osbrick.group = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] privsep_osbrick.helper_command = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] privsep_osbrick.user = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_sys_admin.group = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_sys_admin.helper_command = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] cinder_sys_admin.user = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.auth_section = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.auth_type = password {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.cafile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.collect_timing = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.insecure = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.send_service_user_token = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.split_loggers = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] service_user.timeout = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.auth_section = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.auth_type = password {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.collect_timing = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.insecure = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.region_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.split_loggers = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] glance.timeout = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.backend_availability_zone = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.chap_password = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.chap_username = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack quobyte-client[85875]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 10:03:27 devstack quobyte-client[85875]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.disk_geometry = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.driver_client_cert = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.driver_client_cert_key = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.driver_data_namespace = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.driver_use_ssl = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.extra_capabilities = {} {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.filter_function = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.goodness_function = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.iscsi_target_flags = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.iscsi_write_cache = on {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.iser_helper = tgtadm {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.iser_ip_address = 192.168.122.191 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.iser_port = 3260 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_host = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_login = admin {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_mount_options = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_password = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_private_key = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_share_path = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=85870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: INFO cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba ... Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.num_shell_tries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe -c /etc/quobyte/client-cinder.cfg {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.quobyte_volume_url = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.replication_device = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.report_discard_supported = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.reserved_percentage = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.target_helper = tgtadm {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.target_ip_address = 192.168.122.191 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.target_port = 3260 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.target_protocol = iscsi {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.trace_flags = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.unique_fqdn_network = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.use_chap_auth = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_backend_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_clear = zero {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_clear_ionice = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_clear_size = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_reports.file_event_handler = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_reports.log_dir = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.backend_availability_zone = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.backend_host = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.chap_password = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.chap_username = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.chiscsi_conf = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.disk_geometry = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.driver_client_cert = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.driver_data_namespace = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.driver_use_ssl = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.extra_capabilities = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.filter_function = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.goodness_function = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.iser_helper = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.iser_ip_address = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.iser_port = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.iser_target_prefix = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_host = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_login = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_mount_options = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_password = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_private_key = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_share_path = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_ssh_port = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.num_shell_tries = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.nvmet_port_id = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.replication_device = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.report_discard_supported = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.reserved_percentage = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.scst_target_driver = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.storage_protocol = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.target_helper = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.target_ip_address = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.target_port = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.target_prefix = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.target_protocol = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.trace_flags = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.use_chap_auth = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_clear = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_clear_size = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] QuobyteHD.volumes_dir = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe -c /etc/quobyte/client-cinder.cfg Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.ssl = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_notifications.driver = [] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_notifications.retry = -1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] key_manager.fixed_key = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.barbican_api_version = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.barbican_endpoint = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.barbican_endpoint_type = public {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.barbican_region_name = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.cafile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.collect_timing = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.insecure = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.number_of_retries = 60 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.retry_delay = 1 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.send_service_user_token = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.split_loggers = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.timeout = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.verify_ssl = True {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican.verify_ssl_path = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.auth_section = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.auth_type = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.cafile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.certfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.collect_timing = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.insecure = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.keyfile = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.split_loggers = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] barbican_service_user.timeout = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.approle_role_id = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.approle_secret_id = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.kv_mountpoint = secret {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.kv_path = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.kv_version = 2 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.namespace = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.root_token_id = **** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.ssl_ca_crt_file = None {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.timeout = 60.0 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.use_ssl = False {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:27 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] ******************************************************************************** {{(pid=85657) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 10:03:28 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:28 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.839s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:28 devstack cinder-volume[85870]: INFO cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba succeeded Jul 06 10:03:28 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=85870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:03:28 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.852s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:03:28 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:28 devstack sudo[85945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:03:28 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:29 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.599s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:29 devstack cinder-volume[85870]: INFO cinder.volume.driver [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.volume.driver [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6445007324219, 'free_capacity_gb': 1775.6445007324219, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85870) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG oslo_db.sqlalchemy.engines [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85870) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG dbcounter [-] [85870] Writer thread running {{(pid=85870) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.db.api [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Building query based on filter {{(pid=85870) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.image.image_utils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85870) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 10:03:29 devstack cinder-volume[85870]: INFO cinder.keymgr.migration [None req-da9cdd63-7599-4b83-a4be-a615b9703eb7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=85870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=85870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:29 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:03:29 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:29 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.647s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.manager [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Notifying Schedulers of capabilities ... {{(pid=85870) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:03:29 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Driver initialization completed successfully. Jul 06 10:03:29 devstack cinder-volume[85870]: INFO cinder.manager [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Initiating service 3 cleanup Jul 06 10:03:29 devstack cinder-volume[85870]: INFO cinder.manager [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Service 3 cleanup completed. Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.service [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Creating RPC server for service cinder-volume {{(pid=85870) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 10:03:29 devstack cinder-volume[85870]: DEBUG cinder.service [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85870) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 10:03:30 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 10:03:30 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:03:30 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:03:30 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=85870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:03:30 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=85870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:03:30 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:03:30 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:30 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:03:30 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:30 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:30 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.711s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:30 devstack cinder-volume[85870]: INFO cinder.volume.manager [None req-0b7b7162-9f77-430b-b7cd-82033bb6a7d9 None None] Driver post RPC initialization completed successfully. Jul 06 10:03:34 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:03:34 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:03:34 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=85870) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:03:34 devstack cinder-volume[85870]: DEBUG cinder.volume.drivers.quobyte [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=85870) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:03:34 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85870) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:03:34 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:34 devstack sudo[86075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:03:34 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:35 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:35 devstack cinder-volume[85870]: DEBUG oslo_concurrency.processutils [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.658s {{(pid=85870) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:35 devstack cinder-volume[85870]: DEBUG cinder.manager [None req-562e12fa-4b0c-425b-83ed-4405328fb986 None None] Notifying Schedulers of capabilities ... {{(pid=85870) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:03:37 devstack cinder-volume[85657]: DEBUG dbcounter [-] [85657] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85657) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:03:38 devstack cinder-volume[85657]: INFO oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Caught SIGTERM, stopping children Jul 06 10:03:38 devstack cinder-volume[85657]: DEBUG oslo_concurrency.lockutils [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Acquiring lock "singleton_lock" {{(pid=85657) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 10:03:38 devstack cinder-volume[85657]: DEBUG oslo_concurrency.lockutils [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Acquired lock "singleton_lock" {{(pid=85657) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 10:03:38 devstack cinder-volume[85657]: DEBUG oslo_concurrency.lockutils [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Releasing lock "singleton_lock" {{(pid=85657) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 10:03:38 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Stop services. {{(pid=85657) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 10:03:38 devstack cinder-volume[85657]: DEBUG oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Killing children. {{(pid=85657) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 10:03:38 devstack cinder-volume[85657]: INFO oslo_service.backend._eventlet.service [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Waiting on 1 children to exit Jul 06 10:03:39 devstack cinder-volume[85870]: DEBUG dbcounter [-] [85870] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85870) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:03:40 devstack cinder-volume[85870]: DEBUG dbcounter [-] [85870] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=85870) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:03:43 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Acquiring lock "singleton_lock" {{(pid=85870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 10:03:43 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Acquired lock "singleton_lock" {{(pid=85870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 10:03:43 devstack cinder-volume[85870]: DEBUG oslo_concurrency.lockutils [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Releasing lock "singleton_lock" {{(pid=85870) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 10:03:43 devstack cinder-volume[85870]: WARNING amqp [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 10:03:43 devstack cinder-volume[85870]: WARNING amqp [None req-532c8203-c99f-4935-8d5c-0c0446d08da1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 10:03:43 devstack cinder-volume[86166]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 10:03:43 devstack cinder-volume[86166]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 10:03:43 devstack cinder-volume[86166]: we strongly recommend against using it for new projects. Jul 06 10:03:43 devstack cinder-volume[86166]: If you are already using Eventlet, we recommend migrating to a different Jul 06 10:03:43 devstack cinder-volume[86166]: framework. For more detail see Jul 06 10:03:43 devstack cinder-volume[86166]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 10:03:43 devstack cinder-volume[86166]: import eventlet # noqa Jul 06 10:03:46 devstack cinder-volume[86166]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86166) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 10:03:46 devstack cinder-volume[86166]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86166) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 10:03:46 devstack cinder-volume[86166]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86166) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 10:03:46 devstack cinder-volume[86166]: INFO dbcounter [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Registered counter for database cinder Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_db.sqlalchemy.engines [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG dbcounter [-] [86166] Writer thread running {{(pid=86166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 10:03:47 devstack cinder-volume[86166]: INFO cinder.rpc [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 10:03:47 devstack cinder-volume[86166]: INFO cinder.rpc [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_db.sqlalchemy.engines [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:47 devstack cinder-volume[86166]: INFO cinder.volume.manager [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Determined volume DB was empty at startup. Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG cinder.volume.manager [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86166) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 10:03:47 devstack cinder-volume[86166]: WARNING stevedore.named [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 10:03:47 devstack cinder-volume[86166]: WARNING castellan.key_manager [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 10:03:47 devstack cinder-volume[86166]: WARNING cinder.keymgr.conf_key_mgr [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 10:03:47 devstack cinder-volume[86166]: INFO cinder.volume.manager [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_db.sqlalchemy.engines [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:47 devstack cinder-volume[86166]: INFO oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Starting 1 workers Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Started child 86456 {{(pid=86166) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Full set of CONF: {{(pid=86166) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] ******************************************************************************** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] Configuration options gathered from: {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] ================================================================================ {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 10:03:47 devstack cinder-volume[86456]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] allow_availability_zone_fallback = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] allow_compression_on_image_upload = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] allowed_direct_url_schemes = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] api_rate_limit = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] auth_strategy = keystone {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_availability_zone = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_host = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_stats_polling_interval = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backup_api_class = cinder.backup.api.API {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backup_name_template = backup-%s {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backup_use_same_host = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backup_use_temp_snapshot = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] chap_password = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] chap_username = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_internal_tenant_project_id = 1c0d6ebaf8e14f09b3c66de55d38ddd3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_internal_tenant_user_id = a52fcf7ca07a4dada95c56ea329d782f {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cluster = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] compression_format = gzip {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] compute_api_class = cinder.compute.nova.API {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] config_dir = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] config_source = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] control_exchange = openstack {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] debug = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] default_availability_zone = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] default_group_type = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] default_volume_type = QuobyteHD {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] disk_geometry = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] driver_client_cert = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] driver_client_cert_key = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] driver_data_namespace = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] driver_ssl_cert_path = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] driver_ssl_cert_verify = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] driver_use_ssl = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] enable_new_services = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] enable_unsupported_driver = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] enabled_backends = ['QuobyteHD'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] enforce_multipath_for_image_xfer = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] filter_function = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_api_insecure = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_api_servers = ['http://192.168.122.191/image'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_api_ssl_compression = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_ca_certificates_file = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_catalog_info = image:glance:publicURL {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_num_retries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance_request_timeout = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] goodness_function = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] graceful_shutdown_timeout = 5 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] group_api_class = cinder.group.api.API {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] host = devstack {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_compress_on_upload = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_conversion_address_space_limit = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_conversion_cpu_limit = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_conversion_disable = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_upload_use_cinder_backend = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_upload_use_internal_tenant = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_volume_cache_enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_volume_cache_max_count = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] image_volume_cache_max_size_gb = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] init_host_max_objects_retrieval = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] instance_format = [instance: %(uuid)s] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] iscsi_target_flags = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] iscsi_write_cache = on {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] iser_helper = tgtadm {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] iser_ip_address = 192.168.122.191 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] iser_port = 3260 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_color = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_config_append = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_dir = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_file = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_options = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_rotate_interval = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_rotate_interval_type = days {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] log_rotation_type = none {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] max_age = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] max_logfile_count = 30 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] max_logfile_size_mb = 200 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] max_over_subscription_ratio = 20.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] message_reap_interval = 86400 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] message_ttl = 2592000 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] migration_create_volume_timeout_secs = 300 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] monkey_patch = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] monkey_patch_modules = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] my_ip = 192.168.122.191 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] no_snapshot_gb_quota = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] num_iser_scan_tries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] num_shell_tries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] num_volume_device_scan_tries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] nvmeof_conn_info_version = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] nvmet_ns_id = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] nvmet_port_id = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] osapi_max_limit = 1000 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] osapi_volume_ext_list = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] osapi_volume_listen = 0.0.0.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] osapi_volume_listen_port = 8776 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] osapi_volume_use_ssl = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] osapi_volume_workers = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] per_volume_size_limit = -1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] periodic_fuzzy_delay = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] periodic_interval = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] project_id_regex = [0-9a-f\-]+ {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] public_endpoint = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] publish_errors = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] quota_backup_gigabytes = 1000 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] quota_backups = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] quota_gigabytes = 1000 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] quota_groups = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] quota_snapshots = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] quota_volumes = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] rate_limit_burst = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] rate_limit_except_level = CRITICAL {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] rate_limit_interval = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] reinit_driver_count = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] replication_device = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] report_discard_supported = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] report_interval = 120 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] reservation_clean_interval = 86400 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] reservation_expire = 86400 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] reserved_image_namespaces = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] reserved_percentage = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] rpc_response_timeout = 120 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] run_external_periodic_tasks = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] scst_target_driver = iscsi {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] scst_target_iqn_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_down_time = 720 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] shell_completion = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] snapshot_name_template = snapshot-%s {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] split_loggers = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] state_path = /opt/stack/data/cinder {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] storage_availability_zone = nova {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] storage_protocol = iSCSI {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] syslog_log_facility = LOG_USER {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] target_helper = lioadm {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] target_ip_address = 192.168.122.191 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] target_port = 3260 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] target_protocol = iscsi {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] target_secondary_ip_addresses = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] trace_flags = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] transfer_api_class = cinder.transfer.api.API {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] transport_url = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] until_refresh = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] use_chap_auth = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] use_default_quota_class = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] use_journal = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] use_json = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] use_multipath_for_image_xfer = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] use_stderr = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] use_syslog = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] verify_glance_signatures = enabled {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_api_class = cinder.volume.api.API {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_backend_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86456) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_clear = zero {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_clear_ionice = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_clear_size = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_copy_bps_limit = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_dd_blocksize = 1M {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_name_template = volume-%s {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_service_inithost_offload = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volume_usage_audit_period = month {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] zoning_mode = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_concurrency.disable_process_locking = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.auth_section = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.auth_type = password {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.auth_version = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.cache = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.delay_auth_decision = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.http_connect_timeout = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.include_service_catalog = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.insecure = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.interface = public {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_password = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcache_username = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.region_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.service_token_roles_required = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.service_type = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.token_cache_time = 300 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.191/identity {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.backend = dogpile.cache.null {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.backend_argument = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.backend_expiration_time = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.config_prefix = cache.oslo {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.debug_cache_backend = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.enable_retry_client = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.enable_socket_keepalive = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.expiration_time = 600 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.hashclient_retry_attempts = 2 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.memcache_dead_retry = 300 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.memcache_pool_maxsize = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.memcache_sasl_enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.password = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.proxies = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.redis_db = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.redis_sentinel_service_name = mymaster {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.redis_server = localhost:6379 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.retry_attempts = 2 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.retry_delay = 0.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.socket_keepalive_count = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.socket_keepalive_idle = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.socket_keepalive_interval = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.socket_timeout = 1.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.tls_allowed_ciphers = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.tls_cafile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.tls_certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.tls_enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.tls_keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cache.username = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] coordination.backend_url = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.asyncio_connection = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.asyncio_slave_connection = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.backend = sqlalchemy {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.connection = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.connection_debug = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.connection_parameters = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.connection_recycle_time = 3600 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.connection_trace = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.db_inc_retry_interval = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.db_max_retries = 20 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.db_max_retry_interval = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.db_retry_interval = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.max_overflow = 50 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.max_pool_size = 5 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.max_retries = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.mysql_wsrep_sync_wait = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.pool_timeout = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.retry_interval = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.slave_connection = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.sqlite_synchronous = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.synchronous_reader = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] database.use_db_reconnect = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.connection_string = messaging:// {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.es_doc_type = notification {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.es_scroll_size = 10000 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.es_scroll_time = 2m {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.filter_error_trace = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.hmac_keys = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.sentinel_service_name = mymaster {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.socket_timeout = 0.1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.trace_requests = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler.trace_sqlalchemy = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler_jaeger.process_tags = {} {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler_jaeger.service_name_prefix = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] profiler_otlp.service_name_prefix = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.enforce_new_defaults = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.enforce_scope = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.policy_default_rule = default {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.policy_file = policy.yaml {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_policy.remote_timeout = 60.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] privsep_osbrick.group = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] privsep_osbrick.helper_command = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] privsep_osbrick.user = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_sys_admin.group = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_sys_admin.helper_command = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] cinder_sys_admin.user = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.auth_section = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.auth_type = password {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.cafile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.collect_timing = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.insecure = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.send_service_user_token = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.split_loggers = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] service_user.timeout = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.auth_section = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.auth_type = password {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86456) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.collect_timing = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.insecure = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.region_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.split_loggers = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] glance.timeout = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.backend_availability_zone = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Running cmd (subprocess): mount.quobyte {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.chap_password = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.chap_username = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.disk_geometry = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.driver_client_cert = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.driver_client_cert_key = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.driver_data_namespace = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.driver_use_ssl = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.enable_unsupported_driver = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.extra_capabilities = {} {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.filter_function = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.goodness_function = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.iscsi_target_flags = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.iscsi_write_cache = on {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.iser_helper = tgtadm {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.iser_ip_address = 192.168.122.191 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.iser_port = 3260 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_host = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_login = admin {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_mount_options = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_password = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_private_key = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_share_path = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_ssh_port = 22 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.num_shell_tries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.nvmet_port_id = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.quobyte_client_cfg = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.quobyte_volume_url = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.replication_device = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.report_discard_supported = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.reserved_percentage = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.scst_target_driver = iscsi {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.scst_target_iqn_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.storage_protocol = iSCSI {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.target_helper = tgtadm {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.target_ip_address = 192.168.122.191 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.target_port = 3260 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.target_protocol = iscsi {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.trace_flags = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.unique_fqdn_network = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.use_chap_auth = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_backend_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_clear = zero {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_clear_ionice = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_clear_size = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_reports.file_event_handler = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_reports.log_dir = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.backend_availability_zone = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.backend_host = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.chap_password = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.chap_username = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.chiscsi_conf = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.disk_geometry = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.driver_client_cert = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.driver_client_cert_key = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.driver_data_namespace = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.driver_use_ssl = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.extra_capabilities = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.filter_function = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.goodness_function = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.iscsi_target_flags = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.iscsi_write_cache = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.iser_helper = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.iser_ip_address = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.iser_port = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.iser_target_prefix = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_host = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_login = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_mount_options = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_password = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_private_key = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack quobyte-client[86460]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_share_path = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_ssh_port = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack quobyte-client[86460]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.num_shell_tries = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nvmet_ns_id = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.nvmet_port_id = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] CMD "mount.quobyte" returned: 1 in 0.049s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.replication_device = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.report_discard_supported = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.reserved_percentage = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.scst_target_driver = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.storage_protocol = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.target_helper = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.target_ip_address = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.target_port = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.target_prefix = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.target_protocol = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.trace_flags = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.unique_fqdn_network = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.use_chap_auth = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_clear = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_clear_ionice = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_clear_size = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] QuobyteHD.volumes_dir = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.ssl = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.ssl_version = {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_notifications.driver = [] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_notifications.retry = -1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] oslo_messaging_notifications.transport_url = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] key_manager.fixed_key = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.barbican_api_version = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.barbican_endpoint = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.barbican_endpoint_type = public {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.barbican_region_name = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.cafile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.collect_timing = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.insecure = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.number_of_retries = 60 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.retry_delay = 1 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.send_service_user_token = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.split_loggers = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.timeout = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.verify_ssl = True {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican.verify_ssl_path = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.auth_section = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.auth_type = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.cafile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.certfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.collect_timing = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.insecure = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.keyfile = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.split_loggers = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] barbican_service_user.timeout = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.approle_role_id = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.approle_secret_id = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.kv_mountpoint = secret {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.kv_path = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.kv_version = 2 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.namespace = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.root_token_id = **** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.ssl_ca_crt_file = None {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.timeout = 60.0 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.use_ssl = False {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 10:03:47 devstack cinder-volume[86166]: DEBUG oslo_service.backend._eventlet.service [None req-3695cd68-ae6c-49c2-af49-79f4c0e3c29d None None] ******************************************************************************** {{(pid=86166) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 10:03:48 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.630s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:48 devstack cinder-volume[86456]: INFO cinder.volume.driver [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Driver hasn't implemented _init_vendor_properties() Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG cinder.volume.driver [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6445007324219, 'free_capacity_gb': 1775.6445007324219, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86456) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG oslo_db.sqlalchemy.engines [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writer thread running {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG cinder.db.api [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Building query based on filter {{(pid=86456) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86456) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:03:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:48 devstack cinder-volume[86456]: INFO cinder.keymgr.migration [None req-a2efa078-41a6-43e4-8348-31fb5dcf8417 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 10:03:48 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:03:48 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:49 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.625s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:03:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Driver initialization completed successfully. Jul 06 10:03:49 devstack cinder-volume[86456]: INFO cinder.manager [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Initiating service 3 cleanup Jul 06 10:03:49 devstack cinder-volume[86456]: INFO cinder.manager [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Service 3 cleanup completed. Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG cinder.service [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Creating RPC server for service cinder-volume {{(pid=86456) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG cinder.service [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86456) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 10:03:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:03:49 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:03:49 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:03:49 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Jul 06 10:03:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.623s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:03:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bd767b91-b798-4df0-acb6-ba9d00d8841c None None] Driver post RPC initialization completed successfully. Jul 06 10:03:57 devstack cinder-volume[86166]: DEBUG dbcounter [-] [86166] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:03:58 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:03:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:03:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 6 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:03:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:03:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Flow 'volume_create_manager' (8cb95df3-78e9-47eb-a650-311d54883f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c92317-d9a1-440f-8902-954e13398f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c92317-d9a1-440f-8902-954e13398f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1205583883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e2f669-bc27-4f6a-85ef-e71926f87d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f8a3f6b1724dbdbf355b5d7cf56c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:04:46Z,use_quota=True,user_id='d10795c711a249bd8b49a0b9939c9238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c16ef1-f973-4141-829f-7b8403eff461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c16ef1-f973-4141-829f-7b8403eff461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3971666b-9de0-49e4-902e-dd3c45702339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3971666b-9de0-49e4-902e-dd3c45702339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e2f669-bc27-4f6a-85ef-e71926f87d96', 'volume_name': 'volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ed6cac-ae3a-4203-897a-e8b91129712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ed6cac-ae3a-4203-897a-e8b91129712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf77eca4-bea3-4e8f-9582-da02f100eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Volume f2e2f669-bc27-4f6a-85ef-e71926f87d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96', 'volume_size': 1} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1205583883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e2f669-bc27-4f6a-85ef-e71926f87d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f8a3f6b1724dbdbf355b5d7cf56c38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:04:46Z,use_quota=True,user_id='d10795c711a249bd8b49a0b9939c9238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Creating volume f2e2f669-bc27-4f6a-85ef-e71926f87d96 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:04:46 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:46 devstack sudo[86764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 1073741824 Jul 06 10:04:46 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Flow 'volume_create_manager' (67bd11f3-6812-4a06-b414-20c09e6e96a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86808b55-90d0-4238-a60c-1693d4d18d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86808b55-90d0-4238-a60c-1693d4d18d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1659223001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8798c97-e6cd-402b-b611-279601f5817a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35cdb711e4d44a43b784a6ded2a13ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:04:47Z,use_quota=True,user_id='528766e20a3541a08a51ee884c555188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d22c1-78b2-41da-b033-e1074439f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d22c1-78b2-41da-b033-e1074439f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0450745-09e9-4aab-9bd9-dfe357f88512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0450745-09e9-4aab-9bd9-dfe357f88512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8798c97-e6cd-402b-b611-279601f5817a', 'volume_name': 'volume-b8798c97-e6cd-402b-b611-279601f5817a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952a7597-5071-4c4d-b580-7bce6be39256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (952a7597-5071-4c4d-b580-7bce6be39256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8123c834-e3f1-4108-956b-ee6ea7852c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:46 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Volume b8798c97-e6cd-402b-b611-279601f5817a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8798c97-e6cd-402b-b611-279601f5817a', 'volume_size': 1} Jul 06 10:04:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:04:47 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 1073741824" returned: 0 in 1.047s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:47 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 Jul 06 10:04:47 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:48 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96" returned: 0 in 0.777s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1659223001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8798c97-e6cd-402b-b611-279601f5817a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35cdb711e4d44a43b784a6ded2a13ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:04:47Z,use_quota=True,user_id='528766e20a3541a08a51ee884c555188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Creating volume b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:04:48 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:48 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a 1073741824 Jul 06 10:04:48 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf77eca4-bea3-4e8f-9582-da02f100eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b2074e-ed23-4423-9ae6-e2d93dda29c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:48 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Volume volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 (f2e2f669-bc27-4f6a-85ef-e71926f87d96): created successfully Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b2074e-ed23-4423-9ae6-e2d93dda29c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Flow 'volume_create_manager' (8cb95df3-78e9-47eb-a650-311d54883f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:04:48 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-eac885ac-cb61-465c-afb7-434364d8e8c4 tempest-TaggedAttachmentsTest-2006147489 None] Created volume successfully. Jul 06 10:04:49 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a 1073741824" returned: 0 in 0.908s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:49 devstack sudo[87102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a Jul 06 10:04:49 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:50 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a" returned: 0 in 0.809s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8123c834-e3f1-4108-956b-ee6ea7852c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8798c97-e6cd-402b-b611-279601f5817a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8bd40d-da99-4f5a-9a5f-86267e19f756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:04:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Volume volume-b8798c97-e6cd-402b-b611-279601f5817a (b8798c97-e6cd-402b-b611-279601f5817a): created successfully Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8bd40d-da99-4f5a-9a5f-86267e19f756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Flow 'volume_create_manager' (67bd11f3-6812-4a06-b414-20c09e6e96a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:04:50 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-b49711b5-d17c-400a-9a04-2b2ed4dd4070 req-28686208-b7db-4e61-933e-f0107bdac4a4 tempest-VolumesSnapshotsTestJSON-162376618 None] Created volume successfully. Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:04:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Creating offline snapshot 487f2e75-0c3c-4309-a9c5-49d61aa9a73a of volume b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:04:50 devstack cinder-volume[86456]: INFO oslo.privsep.daemon [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpv367_rnh/privsep.sock'] Jul 06 10:04:50 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpv367_rnh/privsep.sock Jul 06 10:04:50 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 10:04:51 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 10:04:52 devstack cinder-volume[86456]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 10:04:52 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:52 devstack cinder-volume[86456]: INFO oslo.privsep.daemon [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Spawned new privsep daemon via rootwrap Jul 06 10:04:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Accepted privsep connection to /tmp/tmpv367_rnh/privsep.sock {{(pid=86456) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 10:04:52 devstack cinder-volume[86456]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 10:04:52 devstack cinder-volume[86456]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 10:04:52 devstack cinder-volume[86456]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 10:04:52 devstack cinder-volume[86456]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87116 Jul 06 10:04:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6974144d-0d2c-4185-a77a-e0fe59439b16]: (2,) {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:04:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd65da90-3aff-4083-82df-c05e83869eb2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:04:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:53 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a Jul 06 10:04:53 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:54 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a" returned: 0 in 1.032s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:54 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a 1G Jul 06 10:04:54 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:55 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a 1G" returned: 0 in 1.303s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8798c97-e6cd-402b-b611-279601f5817a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:55 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8798c97-e6cd-402b-b611-279601f5817a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a Jul 06 10:04:55 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:56 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8798c97-e6cd-402b-b611-279601f5817a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a" returned: 0 in 1.203s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:56 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a is being set with open permissions: ugo+rw Jul 06 10:04:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:56 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a Jul 06 10:04:56 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:57 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a" returned: 0 in 0.859s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:57 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.info Jul 06 10:04:57 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:58 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.info" returned: 0 in 0.975s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:58 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.info is being set with open permissions: ugo+rw Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:58 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.info Jul 06 10:04:58 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:04:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:04:58 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:04:58 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:04:59 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.info" returned: 0 in 0.854s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.515s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:04:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-c792288b-c5b2-4c3e-817b-3846397fa286 req-793c8536-8804-40f0-84a9-246d21d49d3d tempest-VolumesSnapshotsTestJSON-162376618 None] Create snapshot completed successfully Jul 06 10:04:59 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Jul 06 10:04:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.992s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:04:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:04:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:04:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 8 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:04:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "cinder-487f2e75-0c3c-4309-a9c5-49d61aa9a73a-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-487f2e75-0c3c-4309-a9c5-49d61aa9a73a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "cinder-quobyte-b8798c97-e6cd-402b-b611-279601f5817a" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-quobyte-b8798c97-e6cd-402b-b611-279601f5817a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "cinder-quobyte-487f2e75-0c3c-4309-a9c5-49d61aa9a73a" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-quobyte-487f2e75-0c3c-4309-a9c5-49d61aa9a73a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Deleting offline snapshot 487f2e75-0c3c-4309-a9c5-49d61aa9a73a of volume b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] snapshot_file for this snap is: volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3c574c-03f2-42b4-b0d1-0b5e1e297458]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:00 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a Jul 06 10:05:00 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:01 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a" returned: 0 in 1.095s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8798c97-e6cd-402b-b611-279601f5817a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:05:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46b0e7c-547a-4a99-8c2c-1e099cb68f3f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:01 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a Jul 06 10:05:01 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:02 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a" returned: 0 in 1.039s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:02 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a Jul 06 10:05:02 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:03 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a" returned: 0 in 1.036s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:03 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a Jul 06 10:05:03 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:04 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a.487f2e75-0c3c-4309-a9c5-49d61aa9a73a" returned: 0 in 1.014s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-quobyte-487f2e75-0c3c-4309-a9c5-49d61aa9a73a" released by "_delete_snapshot" :: held 4.455s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-quobyte-b8798c97-e6cd-402b-b611-279601f5817a" released by "delete_snapshot" :: held 4.526s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:05 devstack cinder-volume[86456]: WARNING cinder.quota [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:05:05 devstack cinder-volume[86456]: WARNING cinder.quota [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:05:05 devstack cinder-volume[86456]: DEBUG cinder.quota [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Created reservations ['5e00bc84-31cc-4c34-92bb-2631de9d7a45', '6e61cbb5-4ced-4e20-ad1a-6038ef8b25d4', 'c33593b7-b908-4e29-917a-7c8a2e1df457', '17ffd511-4b74-4455-ba4c-05ff8321ca1e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:05:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Delete snapshot completed successfully. Jul 06 10:05:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-b1bb9434-75e0-4d99-8f7e-b3e1bc74382d req-7f8f1d6d-efcd-49b1-b664-078bc7db7f6c tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-487f2e75-0c3c-4309-a9c5-49d61aa9a73a-delete_snapshot" released by "delete_snapshot" :: held 4.838s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "cinder-b8798c97-e6cd-402b-b611-279601f5817a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-b8798c97-e6cd-402b-b611-279601f5817a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "cinder-quobyte-b8798c97-e6cd-402b-b611-279601f5817a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-quobyte-b8798c97-e6cd-402b-b611-279601f5817a" acquired by "delete_volume" :: waited 0.061s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08a8ff1-6d81-473b-a233-4a5588e54b7a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:06 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a Jul 06 10:05:06 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:08 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a" returned: 0 in 1.548s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:08 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a Jul 06 10:05:08 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:09 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b8798c97-e6cd-402b-b611-279601f5817a" returned: 0 in 1.426s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-quobyte-b8798c97-e6cd-402b-b611-279601f5817a" released by "delete_volume" :: held 3.133s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:09 devstack cinder-volume[86456]: WARNING cinder.quota [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG cinder.quota [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Created reservations ['55276ffd-4a00-473e-8608-2461ebfc717a', 'd7cd28be-ac24-4ab0-8235-c01f9fec34dc', '61682dc0-4572-4b99-a91d-fda0df0d2a6e', 'cff16de9-2b35-404c-a25d-30d5578cf2fe'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:09 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:05:09 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:11 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.198s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:11 devstack cinder-volume[86456]: DEBUG cinder.manager [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:05:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Deleted volume successfully. Jul 06 10:05:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-e391179e-5498-4f88-8512-8868aa4a151d req-012a95e4-2cd2-40eb-892f-9fa598f62cd5 tempest-VolumesSnapshotsTestJSON-162376618 None] Lock "cinder-b8798c97-e6cd-402b-b611-279601f5817a-delete_volume" released by "delete_volume" :: held 4.837s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Flow 'volume_create_manager' (b52265e9-f584-48ef-8027-b6afd2c877b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66f9920-7786-4e54-96e6-ca68e44bedc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66f9920-7786-4e54-96e6-ca68e44bedc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-513849002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfab028-3834-45ba-b930-3d8c4f6be0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfab2f8662d947858143a5a00c512050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:14Z,use_quota=True,user_id='c8f2ecad906b4c109748d5037a3a509a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb687881-f774-488d-b295-fe6537eae7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb687881-f774-488d-b295-fe6537eae7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa0f6d8-d078-4a3d-98b4-683c831860be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa0f6d8-d078-4a3d-98b4-683c831860be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfab028-3834-45ba-b930-3d8c4f6be0fd', 'volume_name': 'volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8981bd50-86a1-4c11-b48d-8213d5d272fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8981bd50-86a1-4c11-b48d-8213d5d272fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecbcc62-c341-4bef-a175-0daa1a6b6b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:13 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Volume 6dfab028-3834-45ba-b930-3d8c4f6be0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd', 'volume_size': 1} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-513849002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfab028-3834-45ba-b930-3d8c4f6be0fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfab2f8662d947858143a5a00c512050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:14Z,use_quota=True,user_id='c8f2ecad906b4c109748d5037a3a509a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Creating volume 6dfab028-3834-45ba-b930-3d8c4f6be0fd {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:05:13 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:05:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:13 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd 1073741824 Jul 06 10:05:13 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:15 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd 1073741824" returned: 0 in 2.146s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:15 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd Jul 06 10:05:16 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:16 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd" returned: 0 in 0.954s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] <== create_volume: return (3203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:05:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.211s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cecbcc62-c341-4bef-a175-0daa1a6b6b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cbda4f-d76e-4395-8be9-47e149890410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:16 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Volume volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd (6dfab028-3834-45ba-b930-3d8c4f6be0fd): created successfully Jul 06 10:05:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cbda4f-d76e-4395-8be9-47e149890410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Flow 'volume_create_manager' (b52265e9-f584-48ef-8027-b6afd2c877b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:05:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7c2d0f53-9bfc-479b-9b7e-f6aebfe8afae tempest-VolumesAdminNegativeTest-467606405 None] Created volume successfully. Jul 06 10:05:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Acquiring lock "cinder-6dfab028-3834-45ba-b930-3d8c4f6be0fd-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Lock "cinder-6dfab028-3834-45ba-b930-3d8c4f6be0fd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Acquiring lock "cinder-quobyte-6dfab028-3834-45ba-b930-3d8c4f6be0fd" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Lock "cinder-quobyte-6dfab028-3834-45ba-b930-3d8c4f6be0fd" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:19 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b41b5c-4c50-4a47-9ff8-f4a2668724ab]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:19 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd Jul 06 10:05:19 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:20 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd" returned: 0 in 1.510s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:20 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd Jul 06 10:05:20 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Flow 'volume_create_manager' (98e90526-621a-4916-8812-52117597bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3894d105-5562-4968-b5c4-58885005fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3894d105-5562-4968-b5c4-58885005fffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2018261325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867257d3-28c4-43ad-9a10-3a4a03548595,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='232b3ca8fad74cbf91f6aff7f7d43a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:22Z,use_quota=True,user_id='4e5af6afeaae45969e0fdd0edac3ab98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd37046b-eb32-4aac-9698-d77d9e279de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd37046b-eb32-4aac-9698-d77d9e279de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d77701c-1b3e-4839-814b-72f9fceff6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d77701c-1b3e-4839-814b-72f9fceff6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '867257d3-28c4-43ad-9a10-3a4a03548595', 'volume_name': 'volume-867257d3-28c4-43ad-9a10-3a4a03548595', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5372b53-c33b-4c7a-a783-940ecbcfb172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5372b53-c33b-4c7a-a783-940ecbcfb172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebe6992-895f-4e46-909d-983e429a893e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Volume 867257d3-28c4-43ad-9a10-3a4a03548595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-867257d3-28c4-43ad-9a10-3a4a03548595', 'volume_size': 1} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2018261325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=867257d3-28c4-43ad-9a10-3a4a03548595,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='232b3ca8fad74cbf91f6aff7f7d43a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:22Z,use_quota=True,user_id='4e5af6afeaae45969e0fdd0edac3ab98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Creating volume 867257d3-28c4-43ad-9a10-3a4a03548595 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:05:21 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:05:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:21 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 1073741824 Jul 06 10:05:21 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:22 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6dfab028-3834-45ba-b930-3d8c4f6be0fd" returned: 0 in 1.767s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Lock "cinder-quobyte-6dfab028-3834-45ba-b930-3d8c4f6be0fd" released by "delete_volume" :: held 3.396s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Created reservations ['8f8cb44a-0338-4b2a-ae1a-a1f8744a6aae', 'c33ac1d3-97fa-4d9a-ad35-e71747a4c94a', 'b9b2caed-b437-4e3c-b624-76296ecd0fd1', '13f89986-c10b-4156-aa5f-7fbd7351c298'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:23 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:05:23 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:23 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 1073741824" returned: 0 in 1.794s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:23 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 Jul 06 10:05:23 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:23 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.007s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:23 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:05:24 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Deleted volume successfully. Jul 06 10:05:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89997639-d298-455d-ba53-dea9dedc28ac tempest-VolumesAdminNegativeTest-467606405 None] Lock "cinder-6dfab028-3834-45ba-b930-3d8c4f6be0fd-delete_volume" released by "delete_volume" :: held 5.065s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:25 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595" returned: 0 in 1.520s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] <== create_volume: return (3409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:05:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.412s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebe6992-895f-4e46-909d-983e429a893e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-867257d3-28c4-43ad-9a10-3a4a03548595', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e0693-1607-4f12-ba95-832e6730bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Volume volume-867257d3-28c4-43ad-9a10-3a4a03548595 (867257d3-28c4-43ad-9a10-3a4a03548595): created successfully Jul 06 10:05:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e0693-1607-4f12-ba95-832e6730bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Flow 'volume_create_manager' (98e90526-621a-4916-8812-52117597bd38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:05:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-cae0b3f3-08a5-4306-85be-32b1e5c5add3 req-fcbbcac5-d84d-4a26-a84b-4c3819d2c307 tempest-VolumesGetTestJSON-827953719 None] Created volume successfully. Jul 06 10:05:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Acquiring lock "cinder-867257d3-28c4-43ad-9a10-3a4a03548595-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Lock "cinder-867257d3-28c4-43ad-9a10-3a4a03548595-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Acquiring lock "cinder-quobyte-867257d3-28c4-43ad-9a10-3a4a03548595" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Lock "cinder-quobyte-867257d3-28c4-43ad-9a10-3a4a03548595" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:27 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[081faeda-e317-4cba-8f83-ba5aa9c1aef1]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:27 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 Jul 06 10:05:27 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:28 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595" returned: 0 in 1.491s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:28 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595 Jul 06 10:05:28 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:29 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-867257d3-28c4-43ad-9a10-3a4a03548595" returned: 0 in 0.720s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Lock "cinder-quobyte-867257d3-28c4-43ad-9a10-3a4a03548595" released by "delete_volume" :: held 2.284s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG cinder.quota [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Created reservations ['f5b40471-77ac-4387-88f9-bcf084e5153a', '4958c367-ebed-41cb-8f51-f9cb77a1b4e5', '40699cda-5b17-464b-92c4-84f380a27e96', 'e71c5809-286e-43ba-ad35-41ad499f1811'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:29 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:05:29 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:30 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:30 devstack cinder-volume[86456]: DEBUG cinder.manager [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:05:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Deleted volume successfully. Jul 06 10:05:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-bfd46027-4b86-4849-9de2-915ba64798b3 req-9a1e2750-5ae9-4ba8-9980-ccdc0862b685 tempest-VolumesGetTestJSON-827953719 None] Lock "cinder-867257d3-28c4-43ad-9a10-3a4a03548595-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dd95c3f8-e6e2-4513-a993-f601e547c1f4 tempest-GroupsV314Test-191452635 None] Group tempest-GroupsV314Test-Group-639783086: creating Jul 06 10:05:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dd95c3f8-e6e2-4513-a993-f601e547c1f4 tempest-GroupsV314Test-191452635 None] Group tempest-GroupsV314Test-Group-639783086: created successfully Jul 06 10:05:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dd95c3f8-e6e2-4513-a993-f601e547c1f4 tempest-GroupsV314Test-191452635 None] Create group completed successfully. Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Flow 'volume_create_manager' (17c53db4-cf45-4899-910f-742a536b5bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5332d5b9-dd0d-4417-8461-29e7ecdf73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5332d5b9-dd0d-4417-8461-29e7ecdf73fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906085347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a86a5bb9-4b6d-4b24-a2a1-4ea924c88cb8,host='devstack@QuobyteHD#QuobyteHD',id=cd047975-4eef-4b5e-8aa0-d548b9ce2454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4780dfdc865c4f6582033b5ae4e73f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:37Z,use_quota=True,user_id='b1d826bde1134ac8bcac87fac2be9115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18236d5a-4d40-40b7-8fd9-48ded5f59300),volume_type_id=18236d5a-4d40-40b7-8fd9-48ded5f59300)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e93fd7-1688-4087-857b-d87c8644e3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e93fd7-1688-4087-857b-d87c8644e3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4544e0d-945f-41b3-a345-fb10c5954307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4544e0d-945f-41b3-a345-fb10c5954307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd047975-4eef-4b5e-8aa0-d548b9ce2454', 'volume_name': 'volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbe1ae1-dda1-44af-ae05-ebfd9a3b669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbe1ae1-dda1-44af-ae05-ebfd9a3b669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ab6b24-d9a8-4302-9b20-e655230cc6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Volume cd047975-4eef-4b5e-8aa0-d548b9ce2454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454', 'volume_size': 1} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a86a5bb9-4b6d-4b24-a2a1-4ea924c88cb8,created_at=2026-07-06T08:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906085347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a86a5bb9-4b6d-4b24-a2a1-4ea924c88cb8,host='devstack@QuobyteHD#QuobyteHD',id=cd047975-4eef-4b5e-8aa0-d548b9ce2454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4780dfdc865c4f6582033b5ae4e73f17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:37Z,use_quota=True,user_id='b1d826bde1134ac8bcac87fac2be9115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18236d5a-4d40-40b7-8fd9-48ded5f59300),volume_type_id=18236d5a-4d40-40b7-8fd9-48ded5f59300)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Creating volume cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:05:37 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:05:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:37 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 1073741824 Jul 06 10:05:37 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:38 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 1073741824" returned: 0 in 0.996s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:38 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 Jul 06 10:05:38 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:39 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454" returned: 0 in 0.726s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ab6b24-d9a8-4302-9b20-e655230cc6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b367e8db-a885-4778-976b-289d83f9b1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=50,cinder:SELECT=32,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:05:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Volume volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 (cd047975-4eef-4b5e-8aa0-d548b9ce2454): created successfully Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b367e8db-a885-4778-976b-289d83f9b1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Flow 'volume_create_manager' (17c53db4-cf45-4899-910f-742a536b5bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:05:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-824dece3-83a9-457e-955d-ec75a59da0b7 tempest-GroupsV314Test-191452635 None] Created volume successfully. Jul 06 10:05:41 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=40,cinder:UPDATE=44,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:05:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:41 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Cloning volume cd047975-4eef-4b5e-8aa0-d548b9ce2454 to volume c01b3795-0c33-4fe6-85ab-9d60c6c4c569 Jul 06 10:05:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Creating offline snapshot b4dcdf3d-2255-456f-b86c-b4f3e00da626 of volume cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:05:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[65190ac1-7708-4f01-8363-129aee9fd8a8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:41 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 Jul 06 10:05:41 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:42 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454" returned: 0 in 0.940s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:42 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 1G Jul 06 10:05:42 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:43 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 1G" returned: 0 in 0.908s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:43 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 Jul 06 10:05:43 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:43 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:43 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:05:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:43 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 Jul 06 10:05:43 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:44 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626" returned: 0 in 0.758s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:44 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.info Jul 06 10:05:44 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:45 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.info" returned: 0 in 0.921s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:45 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:05:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:45 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.info Jul 06 10:05:45 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.info" returned: 0 in 0.964s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:46 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Acquiring lock "cinder-quobyte-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] snapshot: b4dcdf3d-2255-456f-b86c-b4f3e00da626, volume: c01b3795-0c33-4fe6-85ab-9d60c6c4c569, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[46740c2c-c7fc-4bbc-8374-b1d20656d0f9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:46 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 Jul 06 10:05:46 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:47 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626" returned: 0 in 0.995s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:05:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:05:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:05:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c2020-74e0-43b4-b13e-f5529a61dde2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:47 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 Jul 06 10:05:47 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:48 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454" returned: 0 in 0.805s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:48 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:05:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:48 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 Jul 06 10:05:48 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:55 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" returned: 0 in 6.818s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e6898-aa2b-42bf-9ba0-20cf70be15af]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:55 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 Jul 06 10:05:55 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:56 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454" returned: 0 in 1.368s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:56 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:05:56 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Converted 1024.00 MB image at 150.17 MB/s Jul 06 10:05:56 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:05:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:56 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 Jul 06 10:05:56 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:57 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" returned: 0 in 0.977s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" released by "_copy_volume_from_snapshot" :: held 11.095s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Acquiring lock "cinder-quobyte-b4dcdf3d-2255-456f-b86c-b4f3e00da626" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-b4dcdf3d-2255-456f-b86c-b4f3e00da626" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Deleting offline snapshot b4dcdf3d-2255-456f-b86c-b4f3e00da626 of volume cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] snapshot_file for this snap is: volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a530ba53-9e6d-45dd-a3e4-b7962496ee2f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:58 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 Jul 06 10:05:58 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:05:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:05:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:05:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:05:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:05:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:05:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:58 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:05:58 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:59 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626" returned: 0 in 1.316s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb463cbd-9fa3-40cd-aba0-6099c19b3de1]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Flow 'volume_create_manager' (f6518878-9102-4b48-ada3-4348f2b694a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b5a6c8-87b7-40e0-8412-4de3ee7be566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b5a6c8-87b7-40e0-8412-4de3ee7be566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1675728434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f479795c-74e2-4974-8e79-6aa5d7a50cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e3674821d94e979dd8ede300ea2d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:59Z,use_quota=True,user_id='7c6f07e847384fab97ed1604715ae457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ab3ee4-eb6c-40ab-a109-74a57f0eb392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:59 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ab3ee4-eb6c-40ab-a109-74a57f0eb392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:59 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a6ce98-d434-4bfe-be7e-adc7aef80da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a6ce98-d434-4bfe-be7e-adc7aef80da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f479795c-74e2-4974-8e79-6aa5d7a50cbf', 'volume_name': 'volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c076f5-80b3-4862-8be2-c435ed18fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c076f5-80b3-4862-8be2-c435ed18fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e679a3d-52f9-43d1-b0b4-9df1e1f2d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:05:59 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Volume f479795c-74e2-4974-8e79-6aa5d7a50cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf', 'volume_size': 1} Jul 06 10:05:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:00 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.261s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:00 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:00 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:06:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 8 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:06:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:06:00 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454" returned: 0 in 1.055s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:00 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 Jul 06 10:06:00 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:01 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626" returned: 0 in 1.401s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:01 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626 Jul 06 10:06:01 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:02 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454.b4dcdf3d-2255-456f-b86c-b4f3e00da626" returned: 0 in 0.758s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-b4dcdf3d-2255-456f-b86c-b4f3e00da626" released by "_delete_snapshot" :: held 4.715s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.429s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.062s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1675728434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f479795c-74e2-4974-8e79-6aa5d7a50cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e3674821d94e979dd8ede300ea2d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:05:59Z,use_quota=True,user_id='7c6f07e847384fab97ed1604715ae457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Creating volume f479795c-74e2-4974-8e79-6aa5d7a50cbf {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:06:02 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:06:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:02 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf 1073741824 Jul 06 10:06:02 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4f10d088-1510-4f39-b59c-fec838ded6af tempest-GroupsV314Test-191452635 None] Create group from source-group-a86a5bb9-4b6d-4b24-a2a1-4ea924c88cb8 completed successfully. Jul 06 10:06:03 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf 1073741824" returned: 0 in 1.182s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:03 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf Jul 06 10:06:03 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Acquiring lock "cinder-quobyte-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" acquired by "delete_volume" :: waited 0.071s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5dce81-9af6-41ef-b685-c593e77f167f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:04 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 Jul 06 10:06:04 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:05 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf" returned: 0 in 1.295s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] <== create_volume: return (2534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:06:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.540s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e679a3d-52f9-43d1-b0b4-9df1e1f2d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb91f9e9-3a6b-47e2-8e46-8a6b166fe0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Volume volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf (f479795c-74e2-4974-8e79-6aa5d7a50cbf): created successfully Jul 06 10:06:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb91f9e9-3a6b-47e2-8e46-8a6b166fe0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Flow 'volume_create_manager' (f6518878-9102-4b48-ada3-4348f2b694a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:06:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-aacf0bcb-43ae-42c5-b1ff-0b95501bd9b1 tempest-DeleteServersTestJSON-2004619803 None] Created volume successfully. Jul 06 10:06:06 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" returned: 0 in 1.518s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:06 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569 Jul 06 10:06:06 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:07 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" returned: 0 in 1.420s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-c01b3795-0c33-4fe6-85ab-9d60c6c4c569" released by "delete_volume" :: held 3.055s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Created reservations ['90c4f051-e8f3-4fd7-8ea5-ffcce8bec3f4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:07 devstack cinder-volume[86456]: WARNING cinder.quota [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1414806260 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1414806260, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:06:07 devstack cinder-volume[86456]: WARNING cinder.quota [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1414806260 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1414806260, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Created reservations ['87411865-df30-4619-831a-2360313883d3', 'acaa7968-6f93-4a22-85ba-06f58af700db', '78976666-335c-4b9d-9164-14916d9fb606', 'b875ce0d-8710-45da-9e61-1a893b45d566'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:08 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:08 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Acquiring lock "cinder-quobyte-cd047975-4eef-4b5e-8aa0-d548b9ce2454" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-cd047975-4eef-4b5e-8aa0-d548b9ce2454" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b53f08-5004-480c-b4a0-628be52d4a43]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:09 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 Jul 06 10:06:09 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:09 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.354s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:09 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:09 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bb0a4264-5fc9-426a-aa4f-5b67ff9b6d24 tempest-GroupsV314Test-191452635 None] Delete group completed successfully. Jul 06 10:06:09 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454" returned: 0 in 0.878s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:09 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454 Jul 06 10:06:09 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:10 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd047975-4eef-4b5e-8aa0-d548b9ce2454" returned: 0 in 0.838s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Lock "cinder-quobyte-cd047975-4eef-4b5e-8aa0-d548b9ce2454" released by "delete_volume" :: held 1.808s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:10 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Created reservations ['6b492208-3092-494b-b43a-66e3d7b4cc6a'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:10 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Created reservations ['72da738b-b132-4814-8b69-3d97ea65b9f8', '6fd1f480-c47f-4309-b2f0-a3b3dea2d14a', 'e503c575-948e-4da0-8efc-2666491760c3', '4443c1a3-c626-4d48-832e-4e277e68af7d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:11 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:11 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:11 devstack cinder-volume[86456]: WARNING py.warnings [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 06 10:06:11 devstack cinder-volume[86456]: .first() Jul 06 10:06:11 devstack cinder-volume[86456]: Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68ea77a-9324-4796-b728-e656e6ae15e8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-d608d20f-7994-4304-b1bb-33c7e7ef87af req-e17f64b3-ba17-4fdb-975e-f04dbc28f201 tempest-TaggedAttachmentsTest-2006147489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:11 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf Jul 06 10:06:11 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:11 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.845s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:11 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-823f2ab9-461e-4bb6-b325-2cc61efe75e4 tempest-GroupsV314Test-191452635 None] Delete group completed successfully. Jul 06 10:06:12 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf" returned: 0 in 0.882s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-d608d20f-7994-4304-b1bb-33c7e7ef87af req-e17f64b3-ba17-4fdb-975e-f04dbc28f201 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.799s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f4068a-6543-4a29-88d4-b783545db5f0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-d608d20f-7994-4304-b1bb-33c7e7ef87af req-e17f64b3-ba17-4fdb-975e-f04dbc28f201 tempest-TaggedAttachmentsTest-2006147489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90b09755-385d-4329-9940-53f381184fd2', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:06:12 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 Jul 06 10:06:12 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-07a3bdbb-742b-4b5c-aa5b-7d508be64810 req-1541eee8-3757-4496-bb07-36cac217b656 tempest-DeleteServersTestJSON-2004619803 None] attachment_update completed successfully. Jul 06 10:06:13 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-d608d20f-7994-4304-b1bb-33c7e7ef87af req-e17f64b3-ba17-4fdb-975e-f04dbc28f201 tempest-TaggedAttachmentsTest-2006147489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96" returned: 0 in 1.054s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-d608d20f-7994-4304-b1bb-33c7e7ef87af req-e17f64b3-ba17-4fdb-975e-f04dbc28f201 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.089s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-d608d20f-7994-4304-b1bb-33c7e7ef87af req-e17f64b3-ba17-4fdb-975e-f04dbc28f201 tempest-TaggedAttachmentsTest-2006147489 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b34d378-07d7-403e-aa76-68a3bd6ec9c8', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:06:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-d608d20f-7994-4304-b1bb-33c7e7ef87af req-e17f64b3-ba17-4fdb-975e-f04dbc28f201 tempest-TaggedAttachmentsTest-2006147489 None] attachment_update completed successfully. Jul 06 10:06:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-290d3f36-4189-4bce-ba64-0f865f778dd3 tempest-GroupsV320Test-592595188 None] Group tempest-GroupsV320Test-Group-772206043: creating Jul 06 10:06:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-290d3f36-4189-4bce-ba64-0f865f778dd3 tempest-GroupsV320Test-592595188 None] Group tempest-GroupsV320Test-Group-772206043: created successfully Jul 06 10:06:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-290d3f36-4189-4bce-ba64-0f865f778dd3 tempest-GroupsV320Test-592595188 None] Create group completed successfully. Jul 06 10:06:19 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Created reservations ['2bf43fa5-175b-4ca7-813a-93bc8304886e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:19 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:19 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:20 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.714s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:20 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:20 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-203ef0fb-5fdb-45c4-9d52-a43ac85d1b32 tempest-GroupsV320Test-592595188 None] Delete group completed successfully. Jul 06 10:06:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-1c9504ef-d714-4bc2-bf2d-ad1ce6f79e86 req-f88db60e-d1cc-42f2-9d3e-08ad6468aaf1 tempest-TaggedAttachmentsTest-2006147489 None] Terminate volume connection completed successfully. Jul 06 10:06:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-1c9504ef-d714-4bc2-bf2d-ad1ce6f79e86 req-f88db60e-d1cc-42f2-9d3e-08ad6468aaf1 tempest-TaggedAttachmentsTest-2006147489 None] Deleting attachment 2b34d378-07d7-403e-aa76-68a3bd6ec9c8. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:06:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-54db50d3-0c26-4377-8c5d-f2f9ee66882c req-ab599272-8f1a-4df2-9716-073496a60747 tempest-DeleteServersTestJSON-2004619803 None] Terminate volume connection completed successfully. Jul 06 10:06:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-54db50d3-0c26-4377-8c5d-f2f9ee66882c req-ab599272-8f1a-4df2-9716-073496a60747 tempest-DeleteServersTestJSON-2004619803 None] Deleting attachment 90b09755-385d-4329-9940-53f381184fd2. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Acquiring lock "cinder-f479795c-74e2-4974-8e79-6aa5d7a50cbf-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Lock "cinder-f479795c-74e2-4974-8e79-6aa5d7a50cbf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Acquiring lock "cinder-quobyte-f479795c-74e2-4974-8e79-6aa5d7a50cbf" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Lock "cinder-quobyte-f479795c-74e2-4974-8e79-6aa5d7a50cbf" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9f7315-d9b5-4150-bb5e-1c27a03c002f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:27 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf Jul 06 10:06:27 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Flow 'volume_create_manager' (1ddde57d-f0b0-4dfb-b7b3-03eb17c463d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b91769e-c29a-49ad-bec2-0576c9c41ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b91769e-c29a-49ad-bec2-0576c9c41ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-734104376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1140a688-a6c5-4f68-8b30-4837d291f550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed48e9ee5f64ccd8bb7032db72433f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:06:28Z,use_quota=True,user_id='f91b75926c0640a58e7ce0fba4aa6d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82988f85-a853-4def-ba51-3f5534f5b447),volume_type_id=82988f85-a853-4def-ba51-3f5534f5b447)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40de43ac-708e-4bd3-a17f-6b67f641b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40de43ac-708e-4bd3-a17f-6b67f641b34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42f9944-c6c8-4b66-9183-b07431e72803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42f9944-c6c8-4b66-9183-b07431e72803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1140a688-a6c5-4f68-8b30-4837d291f550', 'volume_name': 'volume-1140a688-a6c5-4f68-8b30-4837d291f550', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469645c3-88d1-4f1c-8ad1-a9dacdf1a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469645c3-88d1-4f1c-8ad1-a9dacdf1a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61314410-d94b-436b-b7f1-d464e3517319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:27 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Volume 1140a688-a6c5-4f68-8b30-4837d291f550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1140a688-a6c5-4f68-8b30-4837d291f550', 'volume_size': 1} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-734104376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1140a688-a6c5-4f68-8b30-4837d291f550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed48e9ee5f64ccd8bb7032db72433f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:06:28Z,use_quota=True,user_id='f91b75926c0640a58e7ce0fba4aa6d67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82988f85-a853-4def-ba51-3f5534f5b447),volume_type_id=82988f85-a853-4def-ba51-3f5534f5b447)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Creating volume 1140a688-a6c5-4f68-8b30-4837d291f550 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:06:27 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:06:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:27 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 1073741824 Jul 06 10:06:27 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:28 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf" returned: 0 in 0.956s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:28 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf Jul 06 10:06:28 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:28 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 1073741824" returned: 0 in 0.967s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:28 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 Jul 06 10:06:28 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:28 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f479795c-74e2-4974-8e79-6aa5d7a50cbf" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Lock "cinder-quobyte-f479795c-74e2-4974-8e79-6aa5d7a50cbf" released by "delete_volume" :: held 1.777s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Created reservations ['f7efb094-8565-4c0e-a027-25a3aaf1aaba', '4d0d84a4-b41d-4aa8-b05a-f06803dc1258', 'bad60736-2a9c-49dd-8635-7cf6ee241c35', '72803c19-e3fa-482a-b449-d852313447e4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:29 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:29 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:29 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550" returned: 0 in 1.007s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61314410-d94b-436b-b7f1-d464e3517319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1140a688-a6c5-4f68-8b30-4837d291f550', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04da2f4-4df9-4e26-8dae-97805ac6edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Volume volume-1140a688-a6c5-4f68-8b30-4837d291f550 (1140a688-a6c5-4f68-8b30-4837d291f550): created successfully Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a04da2f4-4df9-4e26-8dae-97805ac6edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Flow 'volume_create_manager' (1ddde57d-f0b0-4dfb-b7b3-03eb17c463d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:06:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fc119667-62b6-4109-b553-301c93653817 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Created volume successfully. Jul 06 10:06:30 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.196s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:30 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Deleted volume successfully. Jul 06 10:06:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f5c7a9fd-718f-4075-9df9-280b27b76dba tempest-DeleteServersTestJSON-2004619803 None] Lock "cinder-f479795c-74e2-4974-8e79-6aa5d7a50cbf-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:31 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:31 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:32 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.055s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:32 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3f518904-62b6-4118-8f68-970d427f0bd6 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Retype volume completed successfully. Jul 06 10:06:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Acquiring lock "cinder-1140a688-a6c5-4f68-8b30-4837d291f550-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "cinder-1140a688-a6c5-4f68-8b30-4837d291f550-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Acquiring lock "cinder-quobyte-1140a688-a6c5-4f68-8b30-4837d291f550" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "cinder-quobyte-1140a688-a6c5-4f68-8b30-4837d291f550" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a216ee08-78f9-44ae-a2db-fccd74c44beb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:33 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 Jul 06 10:06:33 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:34 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550" returned: 0 in 1.477s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:34 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550 Jul 06 10:06:34 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:35 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1140a688-a6c5-4f68-8b30-4837d291f550" returned: 0 in 1.025s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "cinder-quobyte-1140a688-a6c5-4f68-8b30-4837d291f550" released by "delete_volume" :: held 2.570s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:35 devstack cinder-volume[86456]: WARNING cinder.quota [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:06:35 devstack cinder-volume[86456]: WARNING cinder.quota [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Created reservations ['2224fb48-cf85-494b-b0f6-fe5fed39e4df', '27b3a626-06a1-45f8-9f73-ebb01f5f9555', '2f328130-43d8-4798-9ccb-32a84edee27e', 'f14590fd-6858-4615-b5c8-c2b575ed581d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:35 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:35 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:37 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.178s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:37 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Deleted volume successfully. Jul 06 10:06:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c595f5e4-2532-45b6-8ab6-1c8265a2d0f2 tempest-VolumeRetypeWithoutMigrationTest-934003118 None] Lock "cinder-1140a688-a6c5-4f68-8b30-4837d291f550-delete_volume" released by "delete_volume" :: held 4.184s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Acquiring lock "cinder-f2e2f669-bc27-4f6a-85ef-e71926f87d96-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Lock "cinder-f2e2f669-bc27-4f6a-85ef-e71926f87d96-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=81,cinder:INSERT=9,cinder:UPDATE=55,cinder:DELETE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=48,cinder:UPDATE=63,cinder:INSERT=14,cinder:DELETE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Acquiring lock "cinder-quobyte-f2e2f669-bc27-4f6a-85ef-e71926f87d96" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Lock "cinder-quobyte-f2e2f669-bc27-4f6a-85ef-e71926f87d96" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3d87f-15a4-4b8f-94e6-ad946f39bd5a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:44 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 Jul 06 10:06:44 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Flow 'volume_create_manager' (145fef6a-9b36-42d9-986d-e9ec3e6f688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ead2437-2b54-428c-9c7c-6c8334193b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ead2437-2b54-428c-9c7c-6c8334193b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-533959161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bb6f2c-70ea-4871-bc07-a644ff667efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5a8533b44c4d36818d76e6b98dccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:06:45Z,use_quota=True,user_id='3b6ed911a5e74383b96c0dbf42bd5271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2eefce-861b-4df0-999d-0a6a15bc7358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2eefce-861b-4df0-999d-0a6a15bc7358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779130db-664e-4c6c-ba73-365a8602b902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779130db-664e-4c6c-ba73-365a8602b902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2bb6f2c-70ea-4871-bc07-a644ff667efa', 'volume_name': 'volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6958a4-a355-4c2b-a416-32e5c2c53899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6958a4-a355-4c2b-a416-32e5c2c53899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a44e8db-5719-4944-8bc0-441adf1bc80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:45 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Volume b2bb6f2c-70ea-4871-bc07-a644ff667efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa', 'volume_size': 1} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-533959161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2bb6f2c-70ea-4871-bc07-a644ff667efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5a8533b44c4d36818d76e6b98dccfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:06:45Z,use_quota=True,user_id='3b6ed911a5e74383b96c0dbf42bd5271',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Creating volume b2bb6f2c-70ea-4871-bc07-a644ff667efa {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:06:45 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:45 devstack sudo[88779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa 1073741824 Jul 06 10:06:45 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:45 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96" returned: 0 in 0.852s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:45 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96 Jul 06 10:06:45 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:46 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa 1073741824" returned: 0 in 0.868s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:46 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa Jul 06 10:06:46 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:46 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f2e2f669-bc27-4f6a-85ef-e71926f87d96" returned: 0 in 0.797s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Lock "cinder-quobyte-f2e2f669-bc27-4f6a-85ef-e71926f87d96" released by "delete_volume" :: held 1.707s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Created reservations ['01a5f931-9967-4e37-8e03-bb62e20462a0', 'cbe24cc3-fba5-44ae-8d99-269354f88047', '28ecd412-2e59-4efb-a995-66a9ae78e87b', 'c6f9c06a-06f0-44e1-b24d-7ea428791f83'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:46 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:46 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:47 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa" returned: 0 in 0.953s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a44e8db-5719-4944-8bc0-441adf1bc80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36858ef-723d-462d-b386-1b9c81936897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:47 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Volume volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa (b2bb6f2c-70ea-4871-bc07-a644ff667efa): created successfully Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36858ef-723d-462d-b386-1b9c81936897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Flow 'volume_create_manager' (145fef6a-9b36-42d9-986d-e9ec3e6f688a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:06:47 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8e5d660e-99c2-43fa-a57c-442155ea2015 tempest-VolumesServicesTestJSON-830564255 None] Created volume successfully. Jul 06 10:06:47 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.848s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:47 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Deleted volume successfully. Jul 06 10:06:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cd64b86-c0d4-49bb-9949-8715d22b1463 tempest-TaggedAttachmentsTest-2006147489 None] Lock "cinder-f2e2f669-bc27-4f6a-85ef-e71926f87d96-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Acquiring lock "cinder-b2bb6f2c-70ea-4871-bc07-a644ff667efa-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Lock "cinder-b2bb6f2c-70ea-4871-bc07-a644ff667efa-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Acquiring lock "cinder-quobyte-b2bb6f2c-70ea-4871-bc07-a644ff667efa" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:06:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Lock "cinder-quobyte-b2bb6f2c-70ea-4871-bc07-a644ff667efa" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:06:48 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef99df8-e821-48a8-9d3e-a25f97f3c52c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:06:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:48 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa Jul 06 10:06:48 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:49 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa" returned: 0 in 0.914s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:49 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa Jul 06 10:06:49 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:50 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b2bb6f2c-70ea-4871-bc07-a644ff667efa" returned: 0 in 0.903s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Lock "cinder-quobyte-b2bb6f2c-70ea-4871-bc07-a644ff667efa" released by "delete_volume" :: held 1.916s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Created reservations ['892c0b58-e4f6-42ab-9efc-c1cf61f0aa29', '5720efe1-bc91-48a7-8030-bd6ba0b78727', 'ea64bac7-3537-4046-8417-0035eac997fe', 'cd1a2ee6-0934-45f4-a870-e71b1e2a9fae'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:50 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:50 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:51 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.238s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:51 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Deleted volume successfully. Jul 06 10:06:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0095c284-ec1c-469b-8d8d-0b3949d11c7b tempest-VolumesServicesTestJSON-830564255 None] Lock "cinder-b2bb6f2c-70ea-4871-bc07-a644ff667efa-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Flow 'volume_create_manager' (fa1d7ed4-88b6-4741-bbea-2bbf6ab49a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa53ab5-eda6-4764-9aa8-273334c00dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa53ab5-eda6-4764-9aa8-273334c00dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-19348753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2e3f57-87aa-4108-b2a0-e8a4d39c8915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e66aa331647e4848979b319b70355e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:06:57Z,use_quota=True,user_id='d3828b01fe144dbc84428962097b3aed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1730412-d499-4b6f-b354-ff988358da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1730412-d499-4b6f-b354-ff988358da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6aca0c-93ce-4933-9f41-5b760d52bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6aca0c-93ce-4933-9f41-5b760d52bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2e3f57-87aa-4108-b2a0-e8a4d39c8915', 'volume_name': 'volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11f8747-c38e-44c0-bf50-fd92bb7147f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11f8747-c38e-44c0-bf50-fd92bb7147f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73031a63-c9e8-42f0-a40b-9c67f21e69b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Volume cd2e3f57-87aa-4108-b2a0-e8a4d39c8915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915', 'volume_size': 1} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-19348753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2e3f57-87aa-4108-b2a0-e8a4d39c8915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e66aa331647e4848979b319b70355e61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:06:57Z,use_quota=True,user_id='d3828b01fe144dbc84428962097b3aed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Creating volume cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:06:56 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:06:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:56 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 1073741824 Jul 06 10:06:56 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:58 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 1073741824" returned: 0 in 1.433s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:58 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 Jul 06 10:06:58 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:06:59 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:06:59 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:06:59 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" returned: 0 in 1.244s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] <== create_volume: return (2761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.766s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73031a63-c9e8-42f0-a40b-9c67f21e69b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130f7af0-df9a-43c2-8bf7-ebd42ea77b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:06:59 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Volume volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 (cd2e3f57-87aa-4108-b2a0-e8a4d39c8915): created successfully Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130f7af0-df9a-43c2-8bf7-ebd42ea77b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Flow 'volume_create_manager' (fa1d7ed4-88b6-4741-bbea-2bbf6ab49a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:06:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a66ab5a3-6a99-41ce-9cd1-07cadf1be559 tempest-ServerActionsTestOtherA-597724027 None] Created volume successfully. Jul 06 10:06:59 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.857s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 8 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:06:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:07:09 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=13,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:07:09 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=14,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Flow 'volume_create_manager' (f09c6662-3f2a-4bac-a175-a968f9f9e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e53cea3-15ca-47ba-83fe-60bcb94a6194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e53cea3-15ca-47ba-83fe-60bcb94a6194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1659894006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc037420-a362-42d4-b2c0-6cba0dbb6d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da3d69f6658491f91f2bb34923a7bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:07:22Z,use_quota=True,user_id='a18f2492acf941c1b86f0bc66adb0af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e1be9b-130a-443b-8659-ac9cc185c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e1be9b-130a-443b-8659-ac9cc185c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4387d4c-a6af-4db5-98b8-c99a99849eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:22 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:07:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4387d4c-a6af-4db5-98b8-c99a99849eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc037420-a362-42d4-b2c0-6cba0dbb6d2f', 'volume_name': 'volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7a28a9-65ba-4d20-9195-eb6b60f4afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7a28a9-65ba-4d20-9195-eb6b60f4afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4942185-ba94-4c7d-9176-38ff7160d5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Volume dc037420-a362-42d4-b2c0-6cba0dbb6d2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 10:07:23 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Trying to clone dc037420-a362-42d4-b2c0-6cba0dbb6d2f from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:07:24 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:07:24 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Image download 20.69 MB at 20.69 MB/s Jul 06 10:07:24 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[26edec1b-cf77-45cc-8b61-8401696929e5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:25 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD Jul 06 10:07:25 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:26 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD" returned: 0 in 1.419s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:26 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 is fetched for user a18f2492acf941c1b86f0bc66adb0af7. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:07:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec506fb-2a59-4358-8b78-0fff74484170]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:27 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD Jul 06 10:07:27 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:28 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD" returned: 0 in 1.613s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1659894006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc037420-a362-42d4-b2c0-6cba0dbb6d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da3d69f6658491f91f2bb34923a7bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:07:22Z,use_quota=True,user_id='a18f2492acf941c1b86f0bc66adb0af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Creating volume dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:07:28 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:07:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:28 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f 1073741824 Jul 06 10:07:28 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:30 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f 1073741824" returned: 0 in 2.028s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:30 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f Jul 06 10:07:30 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:31 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" returned: 0 in 0.918s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] <== create_volume: return (3067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:07:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.073s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:31 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Attempting download of 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume dc037420-a362-42d4-b2c0-6cba0dbb6d2f. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:07:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d4f3c7-76a0-451f-99dc-93366535a9f8]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_z1yo960e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:31 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_z1yo960e Jul 06 10:07:31 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:32 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_z1yo960e" returned: 0 in 0.885s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_z1yo960e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:32 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_z1yo960e Jul 06 10:07:32 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:33 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_z1yo960e" returned: 1 in 0.834s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_z1yo960e' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:07:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[57167341-f5c4-4951-b923-56a60eaf5758]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:33 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD Jul 06 10:07:33 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:34 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD" returned: 0 in 1.056s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:34 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] 58ff08d4-fcf7-43ec-b9cb-ad129e740264 was qcow2, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:07:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:34 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f Jul 06 10:07:34 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:37 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" returned: 0 in 3.013s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:37 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_9epbqr2zdevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:07:37 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Converted 112.00 MB image at 37.13 MB/s Jul 06 10:07:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:37 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f 1G Jul 06 10:07:37 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:38 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f 1G" returned: 0 in 0.793s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f49cae9-d3d3-4238-9ff1-e1597c07de4d]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:38 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f Jul 06 10:07:38 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:38 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" returned: 0 in 0.740s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:38 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f Jul 06 10:07:38 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:39 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" returned: 1 in 0.744s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Downloaded image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume dc037420-a362-42d4-b2c0-6cba0dbb6d2f successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 for user a18f2492acf941c1b86f0bc66adb0af7 is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Marking volume dc037420-a362-42d4-b2c0-6cba0dbb6d2f as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Copying metadata from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 to dc037420-a362-42d4-b2c0-6cba0dbb6d2f. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Creating volume glance metadata for volume dc037420-a362-42d4-b2c0-6cba0dbb6d2f backed by image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4942185-ba94-4c7d-9176-38ff7160d5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b316ed1-f077-46fe-8faf-d23298e19008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Volume volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f (dc037420-a362-42d4-b2c0-6cba0dbb6d2f): created successfully Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b316ed1-f077-46fe-8faf-d23298e19008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Flow 'volume_create_manager' (f09c6662-3f2a-4bac-a175-a968f9f9e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:07:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b10b5410-e98c-4077-8ee7-4c1c01d1fe94 tempest-VolumesImageMetadata-1206799450 None] Created volume successfully. Jul 06 10:07:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Acquiring lock "cinder-dc037420-a362-42d4-b2c0-6cba0dbb6d2f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:07:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Lock "cinder-dc037420-a362-42d4-b2c0-6cba0dbb6d2f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:07:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Acquiring lock "cinder-quobyte-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:07:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Lock "cinder-quobyte-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:07:40 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a1871-3d91-43c8-9b41-1e06bbd11827]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:40 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f Jul 06 10:07:40 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:41 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" returned: 0 in 0.770s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:41 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f Jul 06 10:07:41 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:42 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" returned: 1 in 0.883s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:07:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:42 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f Jul 06 10:07:42 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:43 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" returned: 0 in 0.720s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Lock "cinder-quobyte-dc037420-a362-42d4-b2c0-6cba0dbb6d2f" released by "delete_volume" :: held 2.442s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Created reservations ['754a29c4-fb59-484b-ba08-a6aa7a671dcc', 'fcc54a5c-1b01-4f4e-aa4e-a21d0b4fd5de', 'fee50e16-854c-4470-b77d-1a45303a947f', '2dab1b14-b82c-4999-bad3-ab9382bf6cd6'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:43 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:07:43 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:44 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.945s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:44 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:07:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Deleted volume successfully. Jul 06 10:07:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9601cfd4-1466-443a-b991-d99c5824583a tempest-VolumesImageMetadata-1206799450 None] Lock "cinder-dc037420-a362-42d4-b2c0-6cba0dbb6d2f-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Flow 'volume_create_manager' (c6abc690-2ee8-48e3-abd7-bc2dc8e9a68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a159be-c8ca-4751-a1a3-d1d4862cd215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a159be-c8ca-4751-a1a3-d1d4862cd215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2028403506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bbac38-b5dc-4406-9031-f23768310310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3261966a1d64a29b115e0794a527861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:07:48Z,use_quota=True,user_id='7e5d37e06a0240b482d2bd17f6f7f7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12917f2-9395-4cdf-83ea-923273ec5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12917f2-9395-4cdf-83ea-923273ec5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed25e075-818c-4f27-9957-106577d6ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed25e075-818c-4f27-9957-106577d6ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76bbac38-b5dc-4406-9031-f23768310310', 'volume_name': 'volume-76bbac38-b5dc-4406-9031-f23768310310', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d5c4b-ea6e-426c-be98-6b80aafc7dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83d5c4b-ea6e-426c-be98-6b80aafc7dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728896de-ab9d-4960-907c-fe205b27980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Volume 76bbac38-b5dc-4406-9031-f23768310310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76bbac38-b5dc-4406-9031-f23768310310', 'volume_size': 1} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2028403506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76bbac38-b5dc-4406-9031-f23768310310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3261966a1d64a29b115e0794a527861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:07:48Z,use_quota=True,user_id='7e5d37e06a0240b482d2bd17f6f7f7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Creating volume 76bbac38-b5dc-4406-9031-f23768310310 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:07:48 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:48 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 1073741824 Jul 06 10:07:48 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Flow 'volume_create_manager' (f8c7a150-5a2d-4175-b20f-74cafba5afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09ef7d1-94ed-4f82-bd8e-b545d1dba7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09ef7d1-94ed-4f82-bd8e-b545d1dba7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-338969375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3c07429f484b2db00944765d405666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:07:49Z,use_quota=True,user_id='4d6647beab514b7c9e80c209afe3ce1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301020b-afd7-4205-85f8-13b34d94e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301020b-afd7-4205-85f8-13b34d94e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910cb378-431c-483d-8ac4-020a1bfd9b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910cb378-431c-483d-8ac4-020a1bfd9b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610', 'volume_name': 'volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f974418b-22d8-4972-bffc-503b6a148c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f974418b-22d8-4972-bffc-503b6a148c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc3fa8-3c55-4d81-ac5b-0d9b281b1a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:48 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Volume f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610', 'volume_size': 1} Jul 06 10:07:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:49 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 1073741824" returned: 0 in 1.062s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:49 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 Jul 06 10:07:49 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:50 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310" returned: 0 in 0.705s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-338969375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3c07429f484b2db00944765d405666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:07:49Z,use_quota=True,user_id='4d6647beab514b7c9e80c209afe3ce1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Creating volume f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:07:50 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728896de-ab9d-4960-907c-fe205b27980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76bbac38-b5dc-4406-9031-f23768310310', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8f3293-e63d-4535-880e-70bdbed6563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:50 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 1073741824 Jul 06 10:07:50 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Volume volume-76bbac38-b5dc-4406-9031-f23768310310 (76bbac38-b5dc-4406-9031-f23768310310): created successfully Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8f3293-e63d-4535-880e-70bdbed6563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Flow 'volume_create_manager' (c6abc690-2ee8-48e3-abd7-bc2dc8e9a68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:07:50 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-74687ef5-ccd1-48cb-a3a1-ec25a11a04df tempest-AttachVolumeShelveTestJSON-1627850484 None] Created volume successfully. Jul 06 10:07:51 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 1073741824" returned: 0 in 0.995s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:51 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 Jul 06 10:07:51 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:52 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" returned: 0 in 0.893s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddc3fa8-3c55-4d81-ac5b-0d9b281b1a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3875ab-5832-4c06-b40a-aaec58248c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:07:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Volume volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 (f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610): created successfully Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3875ab-5832-4c06-b40a-aaec58248c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Flow 'volume_create_manager' (f8c7a150-5a2d-4175-b20f-74cafba5afb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:07:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7910089e-2dd0-450b-8cd4-faeacccc87a9 tempest-SnapshotMetadataTestJSON-1758061304 None] Created volume successfully. Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-73fb7883-0d01-4eb1-9a8c-a4dbe97fc8e1 req-ca08aed0-a80a-4325-bfa4-afd5019aa36b tempest-ServerActionsTestOtherA-597724027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-73fb7883-0d01-4eb1-9a8c-a4dbe97fc8e1 req-ca08aed0-a80a-4325-bfa4-afd5019aa36b tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b20b42b-b4e3-40a2-b961-a87ee5ba8c4c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-73fb7883-0d01-4eb1-9a8c-a4dbe97fc8e1 req-ca08aed0-a80a-4325-bfa4-afd5019aa36b tempest-ServerActionsTestOtherA-597724027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:52 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 Jul 06 10:07:52 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:53 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-73fb7883-0d01-4eb1-9a8c-a4dbe97fc8e1 req-ca08aed0-a80a-4325-bfa4-afd5019aa36b tempest-ServerActionsTestOtherA-597724027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" returned: 0 in 1.064s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-73fb7883-0d01-4eb1-9a8c-a4dbe97fc8e1 req-ca08aed0-a80a-4325-bfa4-afd5019aa36b tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.087s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.419s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Creating offline snapshot 97417b46-c7f9-420e-bb29-c3b8a3a935aa of volume f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-73fb7883-0d01-4eb1-9a8c-a4dbe97fc8e1 req-ca08aed0-a80a-4325-bfa4-afd5019aa36b tempest-ServerActionsTestOtherA-597724027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '891b3686-3ed0-4363-8a72-37b843529e58', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[948f63dc-4749-4202-9736-5d60a8f63612]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:07:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:53 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-73fb7883-0d01-4eb1-9a8c-a4dbe97fc8e1 req-ca08aed0-a80a-4325-bfa4-afd5019aa36b tempest-ServerActionsTestOtherA-597724027 None] attachment_update completed successfully. Jul 06 10:07:54 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 Jul 06 10:07:54 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:55 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" returned: 0 in 1.187s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:55 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa 1G Jul 06 10:07:55 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:56 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa 1G" returned: 0 in 1.168s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:56 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa Jul 06 10:07:56 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:56 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa" returned: 0 in 0.757s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:56 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa is being set with open permissions: ugo+rw Jul 06 10:07:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:57 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa Jul 06 10:07:57 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:57 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa" returned: 0 in 0.709s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:57 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.info Jul 06 10:07:57 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:58 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.info" returned: 0 in 0.668s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:58 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.info is being set with open permissions: ugo+rw Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:58 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.info Jul 06 10:07:58 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:07:58 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:07:58 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:07:59 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.info" returned: 0 in 0.748s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.441s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:07:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7ede5dce-0207-4693-bc6b-19d1e18297d0 tempest-SnapshotMetadataTestJSON-1758061304 None] Create snapshot completed successfully Jul 06 10:07:59 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Jul 06 10:07:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.808s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:07:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "cinder-97417b46-c7f9-420e-bb29-c3b8a3a935aa-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-97417b46-c7f9-420e-bb29-c3b8a3a935aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "cinder-quobyte-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-quobyte-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "cinder-quobyte-97417b46-c7f9-420e-bb29-c3b8a3a935aa" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-quobyte-97417b46-c7f9-420e-bb29-c3b8a3a935aa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Deleting offline snapshot 97417b46-c7f9-420e-bb29-c3b8a3a935aa of volume f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] snapshot_file for this snap is: volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[716d0a82-b403-4a67-83e1-d2bb3b4decde]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:01 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa Jul 06 10:08:01 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Flow 'volume_create_manager' (aa46b9d5-85fc-4eb5-b044-84ffb22db378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca99157-cf16-490e-8e34-80842adedb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca99157-cf16-490e-8e34-80842adedb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-761750928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84e5e14-164b-43dc-8ba2-fe413fe500df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e2d65120704b90ba7a0c977205f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:01Z,use_quota=True,user_id='2f425be522c147b9afa39a02695157b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2254caef-95c8-4847-ad4a-51fce4090929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2254caef-95c8-4847-ad4a-51fce4090929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66305db4-84dc-4148-8374-7e189828d9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66305db4-84dc-4148-8374-7e189828d9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84e5e14-164b-43dc-8ba2-fe413fe500df', 'volume_name': 'volume-a84e5e14-164b-43dc-8ba2-fe413fe500df', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0868482-5669-4f44-937d-f718ca4a3888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0868482-5669-4f44-937d-f718ca4a3888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653ccb92-8688-488f-97f4-6ef818fa3b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Volume a84e5e14-164b-43dc-8ba2-fe413fe500df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84e5e14-164b-43dc-8ba2-fe413fe500df', 'volume_size': 1} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-761750928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84e5e14-164b-43dc-8ba2-fe413fe500df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e2d65120704b90ba7a0c977205f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:01Z,use_quota=True,user_id='2f425be522c147b9afa39a02695157b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Creating volume a84e5e14-164b-43dc-8ba2-fe413fe500df {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:08:01 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:01 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df 1073741824 Jul 06 10:08:01 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:01 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa" returned: 0 in 0.964s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced997de-dac7-48e9-a76d-6ff43a81e480]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:02 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 Jul 06 10:08:02 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-d61c6196-04ea-4b12-85e9-1e2317e8a598 tempest-ServerActionsTestOtherA-597724027 None] Terminate volume connection completed successfully. Jul 06 10:08:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-d61c6196-04ea-4b12-85e9-1e2317e8a598 tempest-ServerActionsTestOtherA-597724027 None] Deleting attachment 891b3686-3ed0-4363-8a72-37b843529e58. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:08:02 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df 1073741824" returned: 0 in 0.989s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:02 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df Jul 06 10:08:02 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:02 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" returned: 0 in 0.887s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:02 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa Jul 06 10:08:02 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:03 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df" returned: 0 in 0.697s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653ccb92-8688-488f-97f4-6ef818fa3b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84e5e14-164b-43dc-8ba2-fe413fe500df', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0a53dc-8a3f-4232-8b73-4d08245e807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Volume volume-a84e5e14-164b-43dc-8ba2-fe413fe500df (a84e5e14-164b-43dc-8ba2-fe413fe500df): created successfully Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0a53dc-8a3f-4232-8b73-4d08245e807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Flow 'volume_create_manager' (aa46b9d5-85fc-4eb5-b044-84ffb22db378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-91e7ca73-7dcd-4ca4-acad-08aeaca61a69 tempest-ServersNegativeTestJSON-2084003568 None] Created volume successfully. Jul 06 10:08:03 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa" returned: 0 in 1.011s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:03 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa Jul 06 10:08:03 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:04 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610.97417b46-c7f9-420e-bb29-c3b8a3a935aa" returned: 0 in 0.910s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-quobyte-97417b46-c7f9-420e-bb29-c3b8a3a935aa" released by "_delete_snapshot" :: held 3.904s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-quobyte-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" released by "delete_snapshot" :: held 3.928s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:04 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Created reservations ['0b2f0d4d-d1d1-4a0c-8f2a-855b36a785a0', 'c287836b-5221-4ed3-8579-aeefe8466cd4', '302e1dde-0a79-4f3c-b83e-069c2fc8f950', '9fb921ce-10b0-41bb-9201-19d2e41f11b0'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-a927b7cd-e514-48f9-bd18-2ec5c790c5df tempest-ServerActionsTestOtherA-597724027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-a927b7cd-e514-48f9-bd18-2ec5c790c5df tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fa4bc5-642c-4576-a248-b42de71c3840]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-a927b7cd-e514-48f9-bd18-2ec5c790c5df tempest-ServerActionsTestOtherA-597724027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Delete snapshot completed successfully. Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c924d3f-b282-4c5a-aeb5-67f43cb66fb0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-97417b46-c7f9-420e-bb29-c3b8a3a935aa-delete_snapshot" released by "delete_snapshot" :: held 4.169s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:05 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 Jul 06 10:08:05 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "cinder-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Flow 'volume_create_manager' (7baa015a-2305-44be-b5a5-e524140c6156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6661a2ae-b921-4741-9810-c257166795e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6661a2ae-b921-4741-9810-c257166795e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-736243607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29788697-9f88-45aa-bb82-9f1abc14582b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e2d65120704b90ba7a0c977205f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:06Z,use_quota=True,user_id='2f425be522c147b9afa39a02695157b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f55a0a9-4b43-48d9-ada3-2b0463fa4080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f55a0a9-4b43-48d9-ada3-2b0463fa4080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04268f8c-9a56-4e9b-846e-9d6520e9b71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04268f8c-9a56-4e9b-846e-9d6520e9b71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29788697-9f88-45aa-bb82-9f1abc14582b', 'volume_name': 'volume-29788697-9f88-45aa-bb82-9f1abc14582b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05508116-975e-430c-86c2-a7a2783600bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05508116-975e-430c-86c2-a7a2783600bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1415e0-4b69-4757-b56b-e6f87ee4d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Volume 29788697-9f88-45aa-bb82-9f1abc14582b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29788697-9f88-45aa-bb82-9f1abc14582b', 'volume_size': 1} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "cinder-quobyte-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-quobyte-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2bcd56-de29-4c25-b43e-8b2a3062724c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:06 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 Jul 06 10:08:06 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:06 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-a927b7cd-e514-48f9-bd18-2ec5c790c5df tempest-ServerActionsTestOtherA-597724027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" returned: 0 in 1.083s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-a927b7cd-e514-48f9-bd18-2ec5c790c5df tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.111s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.323s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-736243607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29788697-9f88-45aa-bb82-9f1abc14582b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e2d65120704b90ba7a0c977205f8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:06Z,use_quota=True,user_id='2f425be522c147b9afa39a02695157b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Creating volume 29788697-9f88-45aa-bb82-9f1abc14582b {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:08:06 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:06 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b 1073741824 Jul 06 10:08:06 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-a927b7cd-e514-48f9-bd18-2ec5c790c5df tempest-ServerActionsTestOtherA-597724027 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca906409-cde9-47ff-b31d-53308dfd982d', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:08:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-fb3344eb-419d-40f8-b9a0-b5b63b428eb6 req-a927b7cd-e514-48f9-bd18-2ec5c790c5df tempest-ServerActionsTestOtherA-597724027 None] attachment_update completed successfully. Jul 06 10:08:06 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" returned: 0 in 1.067s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:06 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610 Jul 06 10:08:06 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:07 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b 1073741824" returned: 0 in 1.253s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:07 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b Jul 06 10:08:07 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:07 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" returned: 0 in 0.821s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-quobyte-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610" released by "delete_volume" :: held 1.960s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Created reservations ['0695e997-8568-4328-a5c7-69d2c55263b5', 'a5088af5-2604-4069-b0ce-23b4ff2170bb', 'ab7e8260-c866-4840-bc2f-23b60d23a2fe', '8551e282-d108-4fdf-ae21-323a073ccb52'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:07 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:08:07 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:08 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b" returned: 0 in 0.747s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1415e0-4b69-4757-b56b-e6f87ee4d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29788697-9f88-45aa-bb82-9f1abc14582b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f22636d-6d00-4b37-8f83-371009e2cf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:08 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Volume volume-29788697-9f88-45aa-bb82-9f1abc14582b (29788697-9f88-45aa-bb82-9f1abc14582b): created successfully Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f22636d-6d00-4b37-8f83-371009e2cf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Flow 'volume_create_manager' (7baa015a-2305-44be-b5a5-e524140c6156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-381b69b5-ce2e-44bc-9a7c-400b41f6f216 tempest-ServersNegativeTestJSON-2084003568 None] Created volume successfully. Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-c9cd04da-b629-4ae6-b079-ebae653b562d req-68263e11-5b34-452d-97df-3abe0d64a2d8 tempest-AttachVolumeShelveTestJSON-1627850484 None] No connector for attachment bc9b2ed1-f804-44cd-aad6-b166a2e60c32; skipping storage backend terminate_connection call. {{(pid=86456) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-c9cd04da-b629-4ae6-b079-ebae653b562d req-68263e11-5b34-452d-97df-3abe0d64a2d8 tempest-AttachVolumeShelveTestJSON-1627850484 None] Deleting attachment bc9b2ed1-f804-44cd-aad6-b166a2e60c32. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:08:08 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.869s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:08:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Deleted volume successfully. Jul 06 10:08:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-da47f9ca-888a-4d6b-83fd-13a36827dbd0 tempest-SnapshotMetadataTestJSON-1758061304 None] Lock "cinder-f0a7d483-ab1e-49b3-a7e8-dd4aeb9a9610-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "cinder-29788697-9f88-45aa-bb82-9f1abc14582b-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-29788697-9f88-45aa-bb82-9f1abc14582b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "cinder-quobyte-29788697-9f88-45aa-bb82-9f1abc14582b" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-quobyte-29788697-9f88-45aa-bb82-9f1abc14582b" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb8ca44-1be5-4e23-9ec3-0f73e265467b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:09 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b Jul 06 10:08:09 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b" returned: 0 in 1.156s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:10 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:10 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b Jul 06 10:08:10 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:11 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-29788697-9f88-45aa-bb82-9f1abc14582b" returned: 0 in 1.043s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-quobyte-29788697-9f88-45aa-bb82-9f1abc14582b" released by "delete_volume" :: held 2.255s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Created reservations ['43afc075-d139-48a5-9ca9-c0143b6a8cf2', '7b8a178f-fea7-4671-a051-880cd6fae48b', '307415e1-313c-4f8e-8e80-14fb9a940b02', '27fbcff1-b380-4539-9280-5b8c66cf5357'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:11 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:08:11 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:12 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.700s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:08:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Deleted volume successfully. Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-881ff9a8-72bb-404e-89de-8e4ce06e0f78 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-29788697-9f88-45aa-bb82-9f1abc14582b-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "cinder-a84e5e14-164b-43dc-8ba2-fe413fe500df-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-a84e5e14-164b-43dc-8ba2-fe413fe500df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "cinder-quobyte-a84e5e14-164b-43dc-8ba2-fe413fe500df" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-quobyte-a84e5e14-164b-43dc-8ba2-fe413fe500df" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[164dcbec-185a-4aac-a5b1-b706f73b07b4]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:12 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df Jul 06 10:08:12 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Flow 'volume_create_manager' (26cdc19c-a763-43ed-b1ce-b3438169eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365dc17e-f3d7-4eea-9a30-d7cafe6a54d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (365dc17e-f3d7-4eea-9a30-d7cafe6a54d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-326460915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2126693b-1781-416f-9590-85a66eace5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349a577b58bf472a92bf17e5f45b970e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:13Z,use_quota=True,user_id='d02e2669069042dab4d9d97b96a37ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3e13a2-7b83-415d-a0e1-1e02b3f55e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3e13a2-7b83-415d-a0e1-1e02b3f55e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff73a62-8357-44ef-a9b5-92e030658bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff73a62-8357-44ef-a9b5-92e030658bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2126693b-1781-416f-9590-85a66eace5d9', 'volume_name': 'volume-2126693b-1781-416f-9590-85a66eace5d9', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef774a7-b552-4ac6-b235-a478753ea37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef774a7-b552-4ac6-b235-a478753ea37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1790418c-8bb3-48fa-997d-d4beec542aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:13 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Volume 2126693b-1781-416f-9590-85a66eace5d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2126693b-1781-416f-9590-85a66eace5d9', 'volume_size': 1} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-326460915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2126693b-1781-416f-9590-85a66eace5d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349a577b58bf472a92bf17e5f45b970e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:13Z,use_quota=True,user_id='d02e2669069042dab4d9d97b96a37ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Creating volume 2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:08:13 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:13 devstack sudo[90559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 1073741824 Jul 06 10:08:13 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:13 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df" returned: 0 in 1.056s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:13 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df Jul 06 10:08:13 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:14 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a84e5e14-164b-43dc-8ba2-fe413fe500df" returned: 0 in 0.848s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-quobyte-a84e5e14-164b-43dc-8ba2-fe413fe500df" released by "delete_volume" :: held 1.975s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Created reservations ['91517de9-4d97-4000-a0e6-51dc5b428a41', '7a8efbc8-bce9-408d-99c9-a1114a3e0a6c', '1e0d49f8-8084-4949-9a82-d2399a759637', '7231b782-535a-465c-ab53-4c4a620eb3fc'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:14 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:08:14 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:14 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 1073741824" returned: 0 in 1.216s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:14 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 Jul 06 10:08:14 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:15 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9" returned: 0 in 0.956s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.235s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:15 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.089s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:08:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Deleted volume successfully. Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1790418c-8bb3-48fa-997d-d4beec542aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2126693b-1781-416f-9590-85a66eace5d9', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe64519-af84-419b-b1a4-85d5d2794509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:15 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Volume volume-2126693b-1781-416f-9590-85a66eace5d9 (2126693b-1781-416f-9590-85a66eace5d9): created successfully Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe64519-af84-419b-b1a4-85d5d2794509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Flow 'volume_create_manager' (26cdc19c-a763-43ed-b1ce-b3438169eab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d11cebf-86db-4211-a5fe-50bf633de3b5 tempest-ServersNegativeTestJSON-2084003568 None] Lock "cinder-a84e5e14-164b-43dc-8ba2-fe413fe500df-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3344918c-6c72-40db-84f4-a5320dc2077e tempest-VolumesDeleteCascade-1630429976 None] Created volume successfully. Jul 06 10:08:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Creating offline snapshot ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d of volume 2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:08:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882b92b-5414-4c53-ab34-8993fdc5b1b0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:17 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 Jul 06 10:08:17 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:18 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9" returned: 0 in 1.122s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:18 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d 1G Jul 06 10:08:18 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:19 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d 1G" returned: 0 in 1.232s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2126693b-1781-416f-9590-85a66eace5d9 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:19 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2126693b-1781-416f-9590-85a66eace5d9 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d Jul 06 10:08:19 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:20 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2126693b-1781-416f-9590-85a66eace5d9 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" returned: 0 in 0.889s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:20 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d is being set with open permissions: ugo+rw Jul 06 10:08:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:20 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d Jul 06 10:08:20 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:21 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" returned: 0 in 0.826s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:21 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=62,cinder:INSERT=20,cinder:UPDATE=65,cinder:DELETE=6 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:08:21 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=66,cinder:UPDATE=60,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:08:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:21 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.info Jul 06 10:08:21 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:22 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.info" returned: 0 in 1.231s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:22 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.info is being set with open permissions: ugo+rw Jul 06 10:08:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:22 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.info Jul 06 10:08:22 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:23 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.info" returned: 0 in 0.727s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.190s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c2ab5284-ffde-4535-a351-79265cd8cb1d tempest-VolumesDeleteCascade-1630429976 None] Create snapshot completed successfully Jul 06 10:08:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Creating offline snapshot 4ca8a874-8792-47b0-901e-1349cd939889 of volume 2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:08:24 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebbe6da-9a40-4f11-b062-007c6ed83bd9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:24 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d Jul 06 10:08:24 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:25 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" returned: 0 in 1.109s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2126693b-1781-416f-9590-85a66eace5d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:08:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:25 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 1G Jul 06 10:08:25 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:26 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 1G" returned: 0 in 1.249s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:26 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 Jul 06 10:08:26 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:27 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889" returned: 0 in 0.998s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:27 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 is being set with open permissions: ugo+rw Jul 06 10:08:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:27 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 Jul 06 10:08:27 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:28 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.288s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0b241cad-79dc-41e8-9e7d-e484d8d3836a tempest-VolumesDeleteCascade-1630429976 None] Create snapshot completed successfully Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-2126693b-1781-416f-9590-85a66eace5d9-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-2126693b-1781-416f-9590-85a66eace5d9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Performing cascade delete. {{(pid=86456) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-4ca8a874-8792-47b0-901e-1349cd939889-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-4ca8a874-8792-47b0-901e-1349cd939889-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-4ca8a874-8792-47b0-901e-1349cd939889" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-4ca8a874-8792-47b0-901e-1349cd939889" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Deleting offline snapshot 4ca8a874-8792-47b0-901e-1349cd939889 of volume 2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] snapshot_file for this snap is: volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f74801f-da0e-4fd5-9af1-47d8e00bb9c5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:29 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 Jul 06 10:08:29 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:30 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889" returned: 0 in 0.908s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2126693b-1781-416f-9590-85a66eace5d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:08:30 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56bd3f9-adf9-4c67-b26c-103c79774a82]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:30 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d Jul 06 10:08:30 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:31 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" returned: 0 in 1.035s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2126693b-1781-416f-9590-85a66eace5d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:08:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:31 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 Jul 06 10:08:31 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:32 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889" returned: 0 in 1.407s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:33 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889 Jul 06 10:08:33 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:34 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.4ca8a874-8792-47b0-901e-1349cd939889" returned: 0 in 1.138s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-4ca8a874-8792-47b0-901e-1349cd939889" released by "_delete_snapshot" :: held 4.646s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" released by "delete_snapshot" :: held 4.676s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Created reservations ['9a48786f-0e07-4550-8a20-5665a035fd45', '09f77a21-a87f-43e0-a048-817028306d60', '0c830350-ca90-4cf7-8914-a3bd15e0aac5', '02fd51bc-7218-4904-9f67-78982b9490c3'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Delete snapshot completed successfully. Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-4ca8a874-8792-47b0-901e-1349cd939889-delete_snapshot" released by "delete_snapshot" :: held 4.877s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Deleting offline snapshot ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d of volume 2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] snapshot_file for this snap is: volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1046491-95ec-45be-b016-e34e5905959b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:34 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d Jul 06 10:08:34 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:35 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" returned: 0 in 0.977s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2126693b-1781-416f-9590-85a66eace5d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:08:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e335301-6611-42db-934f-edfc08b93bc1]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:35 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 Jul 06 10:08:35 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:36 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9" returned: 0 in 1.175s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:36 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d Jul 06 10:08:36 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:37 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" returned: 0 in 0.846s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:37 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d Jul 06 10:08:37 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:38 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9.ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" returned: 0 in 0.979s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d" released by "_delete_snapshot" :: held 4.179s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" released by "delete_snapshot" :: held 4.230s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Created reservations ['9ac229dd-195a-4d64-b881-66eb8abdbcfc', 'd893eb5d-8056-4018-aa7b-3935baf499c1', '91103a1a-cfed-46ee-b4d8-0389f106bb54', '93ebab12-8a6d-4a30-b1c3-331dca977362'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:38 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Delete snapshot completed successfully. Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-ff8bf2de-9f06-4d43-aac5-1ea8bb1f9e5d-delete_snapshot" released by "delete_snapshot" :: held 4.459s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Snapshots deleted, issuing volume delete {{(pid=86456) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" acquired by "delete_volume" :: waited 0.040s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2977e9ce-69c2-40c4-84f5-92e981d88a16]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-e8e56db8-6ef7-4571-87cf-ed1626dc33be req-0de1a282-0c01-4183-86b5-7b7b1b59556a tempest-ServerActionsTestOtherA-597724027 None] Terminate volume connection completed successfully. Jul 06 10:08:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-e8e56db8-6ef7-4571-87cf-ed1626dc33be req-0de1a282-0c01-4183-86b5-7b7b1b59556a tempest-ServerActionsTestOtherA-597724027 None] Deleting attachment ca906409-cde9-47ff-b31d-53308dfd982d. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:08:39 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 Jul 06 10:08:39 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:40 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9" returned: 0 in 1.077s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:40 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9 Jul 06 10:08:40 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:40 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2126693b-1781-416f-9590-85a66eace5d9" returned: 0 in 0.743s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-2126693b-1781-416f-9590-85a66eace5d9" released by "delete_volume" :: held 1.970s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:40 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Created reservations ['19f5b133-fc73-4712-a704-54d2d3a8c877', '786da97a-cdd1-4453-bfc6-ff204644d7f5', 'ce4254ef-89d6-4ad5-b126-66570a1ce4ab', 'e792c26b-c4d4-4964-af37-a9b181118332'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:41 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:08:41 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:42 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.132s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:42 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:08:42 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Deleted volume successfully. Jul 06 10:08:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c630e7b8-f436-4c4c-936e-3a326cf0f455 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-2126693b-1781-416f-9590-85a66eace5d9-delete_volume" released by "delete_volume" :: held 12.896s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Flow 'volume_create_manager' (1531e0a5-56aa-430e-b9d5-bf8b25f74ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c359dc-e0e7-48b6-9dbd-13f37a9d86bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c359dc-e0e7-48b6-9dbd-13f37a9d86bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-937836440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ef35de-18a4-4351-a95f-0c45ff7d4472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349a577b58bf472a92bf17e5f45b970e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:43Z,use_quota=True,user_id='d02e2669069042dab4d9d97b96a37ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec38a01-c794-4f7a-a580-5e8777208258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec38a01-c794-4f7a-a580-5e8777208258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6520c340-7ade-4b63-8119-f4d7e563a282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6520c340-7ade-4b63-8119-f4d7e563a282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ef35de-18a4-4351-a95f-0c45ff7d4472', 'volume_name': 'volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a88101-1ec3-4cf1-9860-d841e0670286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a88101-1ec3-4cf1-9860-d841e0670286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941dd4a6-abb3-4754-8b25-c6bb35cd3ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:43 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Volume c4ef35de-18a4-4351-a95f-0c45ff7d4472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472', 'volume_size': 1} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-937836440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ef35de-18a4-4351-a95f-0c45ff7d4472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349a577b58bf472a92bf17e5f45b970e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:43Z,use_quota=True,user_id='d02e2669069042dab4d9d97b96a37ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Creating volume c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:08:43 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:08:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:43 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 1073741824 Jul 06 10:08:43 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:44 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 1073741824" returned: 0 in 1.324s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:44 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 Jul 06 10:08:44 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:45 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472" returned: 0 in 1.006s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] <== create_volume: return (2376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:08:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.379s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (941dd4a6-abb3-4754-8b25-c6bb35cd3ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e56c25-eb32-446b-8136-fb820d6e2df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:45 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Volume volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 (c4ef35de-18a4-4351-a95f-0c45ff7d4472): created successfully Jul 06 10:08:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e56c25-eb32-446b-8136-fb820d6e2df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Flow 'volume_create_manager' (1531e0a5-56aa-430e-b9d5-bf8b25f74ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-464666aa-0d4c-4d6a-a8a9-fa1775d2d27f tempest-VolumesDeleteCascade-1630429976 None] Created volume successfully. Jul 06 10:08:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Creating offline snapshot cf386f86-99fc-4839-a961-dc34e5c239b1 of volume c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:08:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c33f21-14a8-4e27-9592-3118dc938426]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:46 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 Jul 06 10:08:46 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:47 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472" returned: 0 in 0.859s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:47 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 1G Jul 06 10:08:47 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:48 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 1G" returned: 0 in 0.809s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:48 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 Jul 06 10:08:48 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:48 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1" returned: 0 in 0.742s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:48 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 is being set with open permissions: ugo+rw Jul 06 10:08:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:48 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 Jul 06 10:08:48 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:49 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1" returned: 0 in 0.706s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:49 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.info Jul 06 10:08:49 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:50 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.info" returned: 0 in 0.762s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:50 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.info is being set with open permissions: ugo+rw Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:50 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.info Jul 06 10:08:50 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Acquiring lock "cinder-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Lock "cinder-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Acquiring lock "cinder-quobyte-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Lock "cinder-quobyte-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[344d15cd-439e-4262-9bb5-45ee660e86c0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:50 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 Jul 06 10:08:50 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:51 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.info" returned: 0 in 0.725s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.740s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4cf5212a-dd81-4c85-9795-accb5d69159e tempest-VolumesDeleteCascade-1630429976 None] Create snapshot completed successfully Jul 06 10:08:51 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" returned: 0 in 0.805s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:51 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915 Jul 06 10:08:51 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:52 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" returned: 0 in 0.810s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Lock "cinder-quobyte-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915" released by "delete_volume" :: held 1.669s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Flow 'volume_create_manager' (fcbf65ed-0f83-407a-a468-a95e2dd27657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad4273-9fac-46a2-b408-b4141920d964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ad4273-9fac-46a2-b408-b4141920d964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1997216568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c28b5c-c826-402c-92ac-ec3a2b4f3a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='349a577b58bf472a92bf17e5f45b970e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf386f86-99fc-4839-a961-dc34e5c239b1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:08:52Z,use_quota=True,user_id='d02e2669069042dab4d9d97b96a37ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ce26f1-17e2-4726-9fa6-014bc873e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ce26f1-17e2-4726-9fa6-014bc873e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3eaf16-5d9d-496e-9169-a34983d1db59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3eaf16-5d9d-496e-9169-a34983d1db59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61c28b5c-c826-402c-92ac-ec3a2b4f3a10', 'volume_name': 'volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10', 'volume_size': 1, 'snapshot_id': 'cf386f86-99fc-4839-a961-dc34e5c239b1'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8227dcf7-5eec-4157-a234-4a54fd775131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8227dcf7-5eec-4157-a234-4a54fd775131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c3808e-5da7-44bf-842f-bff52fed86eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:08:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Volume 61c28b5c-c826-402c-92ac-ec3a2b4f3a10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10', 'volume_size': 1, 'snapshot_id': 'cf386f86-99fc-4839-a961-dc34e5c239b1'} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Created reservations ['4db3d439-ab40-4965-9edd-364e83a43a6d', '56ba4b55-9817-4eab-b51e-4ec843f0c0ee', 'ddc08df9-e104-4fb9-952a-077d9362685c', '50046b6f-55ce-468f-9ceb-225a6e124e99'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-cf386f86-99fc-4839-a961-dc34e5c239b1-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-cf386f86-99fc-4839-a961-dc34e5c239b1-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Creating volume 61c28b5c-c826-402c-92ac-ec3a2b4f3a10 from snapshot cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] snapshot: cf386f86-99fc-4839-a961-dc34e5c239b1, volume: 61c28b5c-c826-402c-92ac-ec3a2b4f3a10, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af5ee1-f6a2-4710-a1a0-50d75a312c74]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:52 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:08:52 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:52 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 Jul 06 10:08:52 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:53 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.004s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:08:53 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Deleted volume successfully. Jul 06 10:08:53 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1" returned: 0 in 1.054s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-daa2aaf3-c39f-4837-9e63-f6fd0fe2e7f0 tempest-ServerActionsTestOtherA-597724027 None] Lock "cinder-cd2e3f57-87aa-4108-b2a0-e8a4d39c8915-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90df9f4-a501-42e4-91c3-4d62606d2e84]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:08:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:53 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 Jul 06 10:08:53 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:54 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Jul 06 10:08:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472" returned: 0 in 0.845s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:08:54 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:08:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:54 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 Jul 06 10:08:54 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:08:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:08:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:08:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:08:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:08:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:08:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:08:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:08:59 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:08:59 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:00 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.842s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:00 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:09:00 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:09:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:09:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:09:01 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" returned: 0 in 7.144s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d89dac-41e1-4db8-8e72-86f65bc9b6a2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:01 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 Jul 06 10:09:01 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:02 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:09:02 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472" returned: 0 in 1.111s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:02 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:09:02 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Converted 1024.00 MB image at 143.32 MB/s Jul 06 10:09:02 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 is being set with open permissions: ugo+rw Jul 06 10:09:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:02 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 Jul 06 10:09:02 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=35,cinder:SELECT=40,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:09:03 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" returned: 0 in 0.923s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" released by "_copy_volume_from_snapshot" :: held 11.218s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-cf386f86-99fc-4839-a961-dc34e5c239b1-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" released by "_create_volume_from_snapshot" :: held 11.268s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.296s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c3808e-5da7-44bf-842f-bff52fed86eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10', 'volume_size': 1, 'snapshot_id': 'cf386f86-99fc-4839-a961-dc34e5c239b1'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24e472e-b60d-4814-b620-4aecb45942a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Volume volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 (61c28b5c-c826-402c-92ac-ec3a2b4f3a10): created successfully Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24e472e-b60d-4814-b620-4aecb45942a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Flow 'volume_create_manager' (fcbf65ed-0f83-407a-a468-a95e2dd27657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e4533c2f-001b-41a1-877d-086b800bb728 tempest-VolumesDeleteCascade-1630429976 None] Created volume successfully. Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-c4ef35de-18a4-4351-a95f-0c45ff7d4472-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-c4ef35de-18a4-4351-a95f-0c45ff7d4472-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Performing cascade delete. {{(pid=86456) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-cf386f86-99fc-4839-a961-dc34e5c239b1-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-cf386f86-99fc-4839-a961-dc34e5c239b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-c4ef35de-18a4-4351-a95f-0c45ff7d4472" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-c4ef35de-18a4-4351-a95f-0c45ff7d4472" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-cf386f86-99fc-4839-a961-dc34e5c239b1" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-cf386f86-99fc-4839-a961-dc34e5c239b1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Deleting offline snapshot cf386f86-99fc-4839-a961-dc34e5c239b1 of volume c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] snapshot_file for this snap is: volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfa2b9f-fc45-40ee-a56a-0b28f0ec5b50]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:05 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 Jul 06 10:09:05 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:05 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1" returned: 0 in 0.871s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:09:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13d2c7-3593-43f4-ac1e-bf256a7d95fa]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:06 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 Jul 06 10:09:06 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:06 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472" returned: 0 in 0.881s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:06 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 Jul 06 10:09:06 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:08 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1" returned: 0 in 1.423s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:08 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1 Jul 06 10:09:08 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Acquiring lock "cinder-76bbac38-b5dc-4406-9031-f23768310310-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "cinder-76bbac38-b5dc-4406-9031-f23768310310-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Acquiring lock "cinder-quobyte-76bbac38-b5dc-4406-9031-f23768310310" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "cinder-quobyte-76bbac38-b5dc-4406-9031-f23768310310" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5116bf-8a57-4b2e-a6b1-df4bf39c0294]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:08 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 Jul 06 10:09:08 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:09 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472.cf386f86-99fc-4839-a961-dc34e5c239b1" returned: 0 in 0.944s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-cf386f86-99fc-4839-a961-dc34e5c239b1" released by "_delete_snapshot" :: held 4.249s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-c4ef35de-18a4-4351-a95f-0c45ff7d4472" released by "delete_snapshot" :: held 4.274s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Created reservations ['4443c8bc-ac8f-4c5b-861e-d4ec699e465f', '8d139d22-f0c4-42ed-8ead-582d722babd3', '1028500a-6abc-4bcf-8128-0d696bd55ff1', '84a1512d-7d9d-41c9-a4b2-716902c8e9e4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:09:09 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Delete snapshot completed successfully. Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-cf386f86-99fc-4839-a961-dc34e5c239b1-delete_snapshot" released by "delete_snapshot" :: held 4.518s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Snapshots deleted, issuing volume delete {{(pid=86456) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-c4ef35de-18a4-4351-a95f-0c45ff7d4472" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-c4ef35de-18a4-4351-a95f-0c45ff7d4472" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0fd656-9ce2-4fa4-95bd-0ddbd95b9748]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:09 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310" returned: 0 in 1.123s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:09 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 Jul 06 10:09:09 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:09 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310 Jul 06 10:09:09 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:10 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-76bbac38-b5dc-4406-9031-f23768310310" returned: 0 in 1.245s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "cinder-quobyte-76bbac38-b5dc-4406-9031-f23768310310" released by "delete_volume" :: held 2.433s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:10 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472" returned: 0 in 1.406s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:10 devstack sudo[91238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472 Jul 06 10:09:10 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:11 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Created reservations ['52420b29-e45f-4ba1-9f49-6ce041935eec', 'adf832c4-7b11-4329-b64e-6deb11e29700', '6ce49b04-5c33-4a63-9f94-36c3e2dce21e', '3f0f1b6a-7dcb-432c-82f6-f27885b785c6'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:09:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:11 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:09:11 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:12 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.269s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:09:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Deleted volume successfully. Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-268beffb-9a6b-45d5-aedf-7493a324301a tempest-AttachVolumeShelveTestJSON-1627850484 None] Lock "cinder-76bbac38-b5dc-4406-9031-f23768310310-delete_volume" released by "delete_volume" :: held 4.136s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:12 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c4ef35de-18a4-4351-a95f-0c45ff7d4472" returned: 0 in 1.645s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-c4ef35de-18a4-4351-a95f-0c45ff7d4472" released by "delete_volume" :: held 3.140s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Created reservations ['f1627dc0-5bff-4ec5-a411-9e617770d315', 'df24103a-3391-47aa-9873-034a6bc8415a', '5eb88feb-ccb5-49be-b84c-15c2f6023069', '46f781aa-a542-409b-8830-c2d0b78c0180'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:12 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:09:12 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-61c28b5c-c826-402c-92ac-ec3a2b4f3a10-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-61c28b5c-c826-402c-92ac-ec3a2b4f3a10-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "cinder-quobyte-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" acquired by "delete_volume" :: waited 0.030s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b5a08-53aa-4494-9977-f9d7d4665d2b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:13 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 Jul 06 10:09:13 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:14 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.596s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:14 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:09:14 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Deleted volume successfully. Jul 06 10:09:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0ff925ce-1bd3-4525-93e6-cfe3fb5041a6 tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-c4ef35de-18a4-4351-a95f-0c45ff7d4472-delete_volume" released by "delete_volume" :: held 9.627s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:15 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" returned: 0 in 1.718s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:15 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10 Jul 06 10:09:15 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:16 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" returned: 0 in 1.033s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-quobyte-61c28b5c-c826-402c-92ac-ec3a2b4f3a10" released by "delete_volume" :: held 2.819s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Created reservations ['ba7cf4bf-5046-497c-be3e-60cdc5e578dc', '312e9e2f-c848-47de-a6c2-7354236804c6', 'da801767-5a1e-43e5-81e2-6d22a60fc39a', '8091032a-8f8b-45e9-882b-4edd1c86bae2'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:16 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:09:16 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:17 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.008s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:17 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:09:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Deleted volume successfully. Jul 06 10:09:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3e8c6f7a-d97c-484e-b0a4-63ff921673fe tempest-VolumesDeleteCascade-1630429976 None] Lock "cinder-61c28b5c-c826-402c-92ac-ec3a2b4f3a10-delete_volume" released by "delete_volume" :: held 4.204s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Flow 'volume_create_manager' (9ec8d73e-aa47-4c28-ab4b-6f9b8f15513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c645746-a719-49f9-bc62-90871cdf8518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c645746-a719-49f9-bc62-90871cdf8518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1544256856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce16d929-b0c2-47a2-b4e6-015d1e50fa31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d260a55155de4b8b9db718b7ea0613ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:22Z,use_quota=True,user_id='d90c397aeb4b4c3080e53c346912c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c8973b-e6b3-401d-a74d-c2ba1681a444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c8973b-e6b3-401d-a74d-c2ba1681a444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d04218-954f-4b5a-8ec6-1dc8860fdd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d04218-954f-4b5a-8ec6-1dc8860fdd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce16d929-b0c2-47a2-b4e6-015d1e50fa31', 'volume_name': 'volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76924154-f52a-45f7-bcf8-9df8e0ccd5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76924154-f52a-45f7-bcf8-9df8e0ccd5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e01b9f2-3fd0-4025-9ece-bb0aa9c1e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Volume ce16d929-b0c2-47a2-b4e6-015d1e50fa31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31', 'volume_size': 1} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1544256856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce16d929-b0c2-47a2-b4e6-015d1e50fa31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d260a55155de4b8b9db718b7ea0613ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:22Z,use_quota=True,user_id='d90c397aeb4b4c3080e53c346912c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Creating volume ce16d929-b0c2-47a2-b4e6-015d1e50fa31 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:09:21 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:09:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:21 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 1073741824 Jul 06 10:09:21 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:22 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 1073741824" returned: 0 in 1.056s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:22 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 Jul 06 10:09:22 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:23 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31" returned: 0 in 0.754s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:09:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e01b9f2-3fd0-4025-9ece-bb0aa9c1e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a942f78b-a666-4903-a440-adec1c9422cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Volume volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 (ce16d929-b0c2-47a2-b4e6-015d1e50fa31): created successfully Jul 06 10:09:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a942f78b-a666-4903-a440-adec1c9422cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Flow 'volume_create_manager' (9ec8d73e-aa47-4c28-ab4b-6f9b8f15513e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7d96d0eb-87cc-45b2-97af-a68dfa88b2cf tempest-VolumesMetadataTest-1332019328 None] Created volume successfully. Jul 06 10:09:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Acquiring lock "cinder-ce16d929-b0c2-47a2-b4e6-015d1e50fa31-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Lock "cinder-ce16d929-b0c2-47a2-b4e6-015d1e50fa31-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Acquiring lock "cinder-quobyte-ce16d929-b0c2-47a2-b4e6-015d1e50fa31" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Lock "cinder-quobyte-ce16d929-b0c2-47a2-b4e6-015d1e50fa31" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07f1d5-a04c-48aa-81e7-1191e3324bc8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:26 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 Jul 06 10:09:26 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:26 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31" returned: 0 in 0.849s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:26 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31 Jul 06 10:09:26 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:27 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ce16d929-b0c2-47a2-b4e6-015d1e50fa31" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Lock "cinder-quobyte-ce16d929-b0c2-47a2-b4e6-015d1e50fa31" released by "delete_volume" :: held 1.633s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Created reservations ['87349722-1f04-4a2d-a044-29c35819dae8', '248bced0-ff64-47f3-abb5-21e832ab98dd', '9b5029a5-fcae-4988-a9b2-fe2867029fb0', '2b46a25e-33f9-44ce-9151-9e4e26cfe2a4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:27 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:09:27 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:28 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.909s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:28 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:09:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Deleted volume successfully. Jul 06 10:09:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c0505abb-b77f-48f4-ba27-d5ec83cb37d7 tempest-VolumesMetadataTest-1332019328 None] Lock "cinder-ce16d929-b0c2-47a2-b4e6-015d1e50fa31-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:32 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Flow 'volume_create_manager' (0cd14374-3e44-40f7-9020-66335e7bf05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9791d40a-94b5-4427-9409-7e7166816ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9791d40a-94b5-4427-9409-7e7166816ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958248476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d719c4a1-d147-4322-8709-85993d1cb385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be505f3ae384bb1a1ff8b9403de4ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:33Z,use_quota=True,user_id='3d5c7102c83946cfb5f78129023a0683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7861ea2f-6e82-4949-8c98-1ec46bafefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7861ea2f-6e82-4949-8c98-1ec46bafefac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65ed0fe-d700-46ea-ba1b-a0c72f883125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65ed0fe-d700-46ea-ba1b-a0c72f883125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd719c4a1-d147-4322-8709-85993d1cb385', 'volume_name': 'volume-d719c4a1-d147-4322-8709-85993d1cb385', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c76053-bec0-46ba-ab7b-c02d74de26c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c76053-bec0-46ba-ab7b-c02d74de26c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9365e81f-eac8-4438-b9c2-7b6f64ad0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Volume d719c4a1-d147-4322-8709-85993d1cb385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d719c4a1-d147-4322-8709-85993d1cb385', 'volume_size': 1} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1958248476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d719c4a1-d147-4322-8709-85993d1cb385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be505f3ae384bb1a1ff8b9403de4ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:33Z,use_quota=True,user_id='3d5c7102c83946cfb5f78129023a0683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Creating volume d719c4a1-d147-4322-8709-85993d1cb385 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:09:33 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:09:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:33 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 1073741824 Jul 06 10:09:33 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:34 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 1073741824" returned: 0 in 1.494s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:34 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 Jul 06 10:09:34 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:35 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385" returned: 0 in 1.033s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] <== create_volume: return (2592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:09:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9365e81f-eac8-4438-b9c2-7b6f64ad0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d719c4a1-d147-4322-8709-85993d1cb385', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c007a146-c0c6-4ee5-86f6-afad3a59f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:35 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Volume volume-d719c4a1-d147-4322-8709-85993d1cb385 (d719c4a1-d147-4322-8709-85993d1cb385): created successfully Jul 06 10:09:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c007a146-c0c6-4ee5-86f6-afad3a59f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Flow 'volume_create_manager' (0cd14374-3e44-40f7-9020-66335e7bf05e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-43dc1b4f-60ce-4914-a55c-b7dfa04716d0 tempest-AttachVolumeNegativeTest-328973155 None] Created volume successfully. Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Flow 'volume_create_manager' (9f7dfb35-37a5-419c-99f5-206aff636ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569b8b0f-ebfa-447f-96e1-ba83456bd434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569b8b0f-ebfa-447f-96e1-ba83456bd434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-357614429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bc7bf3-c85e-46ef-a5d1-c62811440627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d011f0e958c54dd39fab960ed7067bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:37Z,use_quota=True,user_id='450828e2eba54e20b443b0561e0499dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb3f74a-3834-4735-bea1-68bee97da76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb3f74a-3834-4735-bea1-68bee97da76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d86952-6a83-4646-b9f8-5a745ce28d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d86952-6a83-4646-b9f8-5a745ce28d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66bc7bf3-c85e-46ef-a5d1-c62811440627', 'volume_name': 'volume-66bc7bf3-c85e-46ef-a5d1-c62811440627', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5990c437-dd21-4ff7-9d22-30408a8a95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5990c437-dd21-4ff7-9d22-30408a8a95aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ddb766-d4b5-4a61-bb6f-598ecadfc076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:36 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Volume 66bc7bf3-c85e-46ef-a5d1-c62811440627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66bc7bf3-c85e-46ef-a5d1-c62811440627', 'volume_size': 1} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-357614429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66bc7bf3-c85e-46ef-a5d1-c62811440627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d011f0e958c54dd39fab960ed7067bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:37Z,use_quota=True,user_id='450828e2eba54e20b443b0561e0499dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Creating volume 66bc7bf3-c85e-46ef-a5d1-c62811440627 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:09:36 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:09:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:36 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 1073741824 Jul 06 10:09:36 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:37 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 1073741824" returned: 0 in 1.023s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:38 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 Jul 06 10:09:38 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:38 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627" returned: 0 in 0.972s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:09:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ddb766-d4b5-4a61-bb6f-598ecadfc076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66bc7bf3-c85e-46ef-a5d1-c62811440627', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7729e5dc-8d97-4545-a34e-513aa2e7db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Volume volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 (66bc7bf3-c85e-46ef-a5d1-c62811440627): created successfully Jul 06 10:09:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7729e5dc-8d97-4545-a34e-513aa2e7db57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Flow 'volume_create_manager' (9f7dfb35-37a5-419c-99f5-206aff636ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d6c1fd8b-8c31-4853-883e-deb35c3fd4c4 tempest-VolumesTransfersV357Test-1772924457 None] Created volume successfully. Jul 06 10:09:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-2f523a19-c5df-4f5f-b837-4a54a857d1e9 req-4e8a333e-93bf-4fe7-8f76-ad9563697d39 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-2f523a19-c5df-4f5f-b837-4a54a857d1e9 req-4e8a333e-93bf-4fe7-8f76-ad9563697d39 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f2b13a-70b8-467a-8daf-630e30ecd788]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-2f523a19-c5df-4f5f-b837-4a54a857d1e9 req-4e8a333e-93bf-4fe7-8f76-ad9563697d39 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:39 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 Jul 06 10:09:39 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:40 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-2f523a19-c5df-4f5f-b837-4a54a857d1e9 req-4e8a333e-93bf-4fe7-8f76-ad9563697d39 tempest-AttachVolumeNegativeTest-328973155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385" returned: 0 in 1.374s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-2f523a19-c5df-4f5f-b837-4a54a857d1e9 req-4e8a333e-93bf-4fe7-8f76-ad9563697d39 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.397s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-2f523a19-c5df-4f5f-b837-4a54a857d1e9 req-4e8a333e-93bf-4fe7-8f76-ad9563697d39 tempest-AttachVolumeNegativeTest-328973155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-d719c4a1-d147-4322-8709-85993d1cb385', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2becd903-8451-4fdd-8db7-3f9a61ac5a3a', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:09:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-2f523a19-c5df-4f5f-b837-4a54a857d1e9 req-4e8a333e-93bf-4fe7-8f76-ad9563697d39 tempest-AttachVolumeNegativeTest-328973155 None] attachment_update completed successfully. Jul 06 10:09:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-79b5e810-b6d1-45ea-a059-c6de2c14b129 tempest-VolumesTransfersV357Test-1372740733 None] Transfer volume completed successfully. Jul 06 10:09:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Acquiring lock "cinder-66bc7bf3-c85e-46ef-a5d1-c62811440627-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-66bc7bf3-c85e-46ef-a5d1-c62811440627-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Acquiring lock "cinder-quobyte-66bc7bf3-c85e-46ef-a5d1-c62811440627" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-quobyte-66bc7bf3-c85e-46ef-a5d1-c62811440627" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df43b4c-ae3f-4d81-b210-9d80f8d09fe0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:42 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 Jul 06 10:09:42 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:43 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627" returned: 0 in 0.997s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:43 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627 Jul 06 10:09:43 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:44 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-66bc7bf3-c85e-46ef-a5d1-c62811440627" returned: 0 in 0.814s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-quobyte-66bc7bf3-c85e-46ef-a5d1-c62811440627" released by "delete_volume" :: held 1.879s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Created reservations ['3e9eca4c-a67c-4084-9810-fe1370015eb1', 'feb3d84e-d0a2-4f57-a9ee-69ecc1af8d27', 'f889fd2a-fb23-46fe-b71b-d893e184a7fc', '0da3a8bb-f20e-4dc1-b905-acef941ed4ab'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:44 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:09:44 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:45 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:09:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Deleted volume successfully. Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f656d36d-ff75-4a02-af10-282a59b30411 tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-66bc7bf3-c85e-46ef-a5d1-c62811440627-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Flow 'volume_create_manager' (0c948ace-cd15-48bf-8e1b-f19dd0603a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee4e87a-5ddb-4069-bd63-a347c662f8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee4e87a-5ddb-4069-bd63-a347c662f8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-243900504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ffd16-3fe1-4b9a-911a-54c2decd8491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d011f0e958c54dd39fab960ed7067bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:45Z,use_quota=True,user_id='450828e2eba54e20b443b0561e0499dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057e23ce-b0b4-4915-9686-bd9b2e1cb724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057e23ce-b0b4-4915-9686-bd9b2e1cb724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f9b0be-0007-4f36-a902-83a8565caaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f9b0be-0007-4f36-a902-83a8565caaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943ffd16-3fe1-4b9a-911a-54c2decd8491', 'volume_name': 'volume-943ffd16-3fe1-4b9a-911a-54c2decd8491', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd47087-7b2a-414c-ac53-5fdb506cd508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd47087-7b2a-414c-ac53-5fdb506cd508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fd56c2-6add-45b0-ac7a-4a53dd0e436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:45 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Volume 943ffd16-3fe1-4b9a-911a-54c2decd8491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943ffd16-3fe1-4b9a-911a-54c2decd8491', 'volume_size': 1} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-243900504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943ffd16-3fe1-4b9a-911a-54c2decd8491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d011f0e958c54dd39fab960ed7067bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:09:45Z,use_quota=True,user_id='450828e2eba54e20b443b0561e0499dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Creating volume 943ffd16-3fe1-4b9a-911a-54c2decd8491 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:09:45 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:09:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:45 devstack sudo[91816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 1073741824 Jul 06 10:09:45 devstack sudo[91816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:46 devstack sudo[91816]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 1073741824" returned: 0 in 1.263s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:46 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 Jul 06 10:09:46 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:47 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491" returned: 0 in 0.836s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:09:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fd56c2-6add-45b0-ac7a-4a53dd0e436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943ffd16-3fe1-4b9a-911a-54c2decd8491', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d08430-52f4-4f5d-9f97-6c37fd62bd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:09:47 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Volume volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 (943ffd16-3fe1-4b9a-911a-54c2decd8491): created successfully Jul 06 10:09:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d08430-52f4-4f5d-9f97-6c37fd62bd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:09:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Flow 'volume_create_manager' (0c948ace-cd15-48bf-8e1b-f19dd0603a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:09:47 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6c734399-096b-46c2-bfc7-745acf6d5058 tempest-VolumesTransfersV357Test-1772924457 None] Created volume successfully. Jul 06 10:09:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Acquiring lock "cinder-943ffd16-3fe1-4b9a-911a-54c2decd8491-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-943ffd16-3fe1-4b9a-911a-54c2decd8491-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Acquiring lock "cinder-quobyte-943ffd16-3fe1-4b9a-911a-54c2decd8491" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:09:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-quobyte-943ffd16-3fe1-4b9a-911a-54c2decd8491" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:09:49 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa973c-a2b5-4329-9ad1-5c80337e1388]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:09:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:49 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 Jul 06 10:09:49 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:50 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491" returned: 0 in 1.327s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:50 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491 Jul 06 10:09:50 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:51 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-943ffd16-3fe1-4b9a-911a-54c2decd8491" returned: 0 in 1.199s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-quobyte-943ffd16-3fe1-4b9a-911a-54c2decd8491" released by "delete_volume" :: held 2.651s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:51 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Created reservations ['9b953cf9-e50f-476b-b12a-a5d783b4c97e', 'a0440772-eb4e-435e-8979-03000b4b6a2f', '0d7842e1-8f9e-4b63-ba2c-942db5425fc5', '728d872a-9705-4d74-9a84-a99d550b157b'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:09:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:52 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:09:52 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:09:53 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Jul 06 10:09:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.252s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:09:53 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:09:53 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Deleted volume successfully. Jul 06 10:09:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f7ad67e7-e8c4-4853-acc5-939beb5c4beb tempest-VolumesTransfersV357Test-1337814582 None] Lock "cinder-943ffd16-3fe1-4b9a-911a-54c2decd8491-delete_volume" released by "delete_volume" :: held 4.421s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:09:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:09:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:09:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:09:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:09:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:09:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:09:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:09:59 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:09:59 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:01 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 2.176s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:01 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:10:01 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:10:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:10:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:10:02 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=50,cinder:UPDATE=72,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:10:03 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=66,cinder:DELETE=7,cinder:SELECT=51,cinder:INSERT=14 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Flow 'volume_create_manager' (1aa197be-091e-401e-9479-c2717f4df370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91859bd3-3161-4a1d-8434-59a68a74d1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91859bd3-3161-4a1d-8434-59a68a74d1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-772863305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a7495d-9f46-4f3e-926a-e61e48c581cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704cfffb8a934756929cc72ed25a9aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:07Z,use_quota=True,user_id='3b6e33c517a140ab9f3a7f2a5bdac5cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722a7b96-b069-4f0a-a84a-952523d9876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722a7b96-b069-4f0a-a84a-952523d9876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dffbca4-bbd3-4ca1-bb86-8d30bf9559d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dffbca4-bbd3-4ca1-bb86-8d30bf9559d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a7495d-9f46-4f3e-926a-e61e48c581cd', 'volume_name': 'volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd', 'volume_size': 2}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1fe057-8c88-464f-8d3d-aa857285db49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1fe057-8c88-464f-8d3d-aa857285db49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d63253-7048-44a5-b44a-129c378e40fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:07 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Volume f4a7495d-9f46-4f3e-926a-e61e48c581cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd', 'volume_size': 2} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-772863305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a7495d-9f46-4f3e-926a-e61e48c581cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='704cfffb8a934756929cc72ed25a9aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:07Z,use_quota=True,user_id='3b6e33c517a140ab9f3a7f2a5bdac5cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Creating volume f4a7495d-9f46-4f3e-926a-e61e48c581cd {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:10:07 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:10:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd 2147483648 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:07 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd 2147483648 Jul 06 10:10:07 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:09 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd 2147483648" returned: 0 in 1.321s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:09 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd Jul 06 10:10:09 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:10 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd" returned: 0 in 1.241s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] <== create_volume: return (2618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:10:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.621s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d63253-7048-44a5-b44a-129c378e40fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd', 'volume_size': 2}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ae44b4-3f59-4299-86e3-d00ec99e722c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:10 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Volume volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd (f4a7495d-9f46-4f3e-926a-e61e48c581cd): created successfully Jul 06 10:10:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ae44b4-3f59-4299-86e3-d00ec99e722c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Flow 'volume_create_manager' (1aa197be-091e-401e-9479-c2717f4df370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0a6809cd-5d9e-49c0-81c2-a1f8cbd5ef7f tempest-VolumesCloneNegativeTest-1184022766 None] Created volume successfully. Jul 06 10:10:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Acquiring lock "cinder-f4a7495d-9f46-4f3e-926a-e61e48c581cd-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Lock "cinder-f4a7495d-9f46-4f3e-926a-e61e48c581cd-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Acquiring lock "cinder-quobyte-f4a7495d-9f46-4f3e-926a-e61e48c581cd" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Lock "cinder-quobyte-f4a7495d-9f46-4f3e-926a-e61e48c581cd" acquired by "delete_volume" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd90961-dfe5-4620-8802-e7798d24d8ea]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:12 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd Jul 06 10:10:12 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:13 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd" returned: 0 in 1.717s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:13 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd Jul 06 10:10:13 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Flow 'volume_create_manager' (d6b7e042-d7cd-41fa-bfd8-9ec471906a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b3559c-0aca-4be2-95bc-086dc876d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b3559c-0aca-4be2-95bc-086dc876d75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1161064738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5aed0ab-c966-4939-ac76-73d13ad98b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6cddd0ac994e5c83ee362a29b2da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:14Z,use_quota=True,user_id='fd286231f85146a6ac23e0b477c94781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83255b90-6bdf-41d3-a8be-b13f31e56a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83255b90-6bdf-41d3-a8be-b13f31e56a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eeb1c0-4335-4997-81dd-d04258afa27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25eeb1c0-4335-4997-81dd-d04258afa27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5aed0ab-c966-4939-ac76-73d13ad98b2d', 'volume_name': 'volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aadf4a5-7719-440a-944d-fb8e033249e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aadf4a5-7719-440a-944d-fb8e033249e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5dc19f-3127-4ace-b5f4-f51d4f493588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:13 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Volume f5aed0ab-c966-4939-ac76-73d13ad98b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d', 'volume_size': 1} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1161064738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5aed0ab-c966-4939-ac76-73d13ad98b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6cddd0ac994e5c83ee362a29b2da9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:14Z,use_quota=True,user_id='fd286231f85146a6ac23e0b477c94781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Creating volume f5aed0ab-c966-4939-ac76-73d13ad98b2d {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:10:13 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:10:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:14 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d 1073741824 Jul 06 10:10:14 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:15 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f4a7495d-9f46-4f3e-926a-e61e48c581cd" returned: 0 in 1.553s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Lock "cinder-quobyte-f4a7495d-9f46-4f3e-926a-e61e48c581cd" released by "delete_volume" :: held 3.405s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Created reservations ['29a1940d-620e-46ec-8466-3adb6330019b', 'd8c6de38-ec11-442e-9d99-8a20dcbf8b9e', '2b93b8a6-d319-4a46-8542-20aa496c6618', 'b5b32d38-63a0-4fc6-aa51-f024f4cfdcfe'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:15 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:10:15 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:15 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d 1073741824" returned: 0 in 1.768s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:15 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d Jul 06 10:10:15 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:16 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.254s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:16 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:10:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Deleted volume successfully. Jul 06 10:10:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b6a97e68-fb13-476f-a89d-745cb7908d7e tempest-VolumesCloneNegativeTest-1184022766 None] Lock "cinder-f4a7495d-9f46-4f3e-926a-e61e48c581cd-delete_volume" released by "delete_volume" :: held 5.115s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:17 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d" returned: 0 in 1.564s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] <== create_volume: return (3429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:10:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.434s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5dc19f-3127-4ace-b5f4-f51d4f493588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca8521f-8a0c-41ed-a48e-6d143c65209c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:17 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Volume volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d (f5aed0ab-c966-4939-ac76-73d13ad98b2d): created successfully Jul 06 10:10:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ca8521f-8a0c-41ed-a48e-6d143c65209c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Flow 'volume_create_manager' (d6b7e042-d7cd-41fa-bfd8-9ec471906a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-911036d3-3340-4eea-8032-8ced409e34f4 tempest-ServerRescueNegativeTestJSON-1063622114 None] Created volume successfully. Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (99b9a3a9-9e49-48c9-9405-989ca7ac386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93c73d2-070a-4bd2-aa76-0a1baa03768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93c73d2-070a-4bd2-aa76-0a1baa03768a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1704017632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a0705-135b-402a-9bc0-5cfeaf84a018,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:22Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14373544-a97f-42ec-9db7-017d3b835fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14373544-a97f-42ec-9db7-017d3b835fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfe1f29-3ea9-4a44-9188-1cc33b328d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dfe1f29-3ea9-4a44-9188-1cc33b328d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835a0705-135b-402a-9bc0-5cfeaf84a018', 'volume_name': 'volume-835a0705-135b-402a-9bc0-5cfeaf84a018', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a9bf6b-ea15-44c3-bfcb-39b0a2e2a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a9bf6b-ea15-44c3-bfcb-39b0a2e2a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5c9bef-3e31-4d64-95a8-7833f7d9775d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:22 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Volume 835a0705-135b-402a-9bc0-5cfeaf84a018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835a0705-135b-402a-9bc0-5cfeaf84a018', 'volume_size': 1} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1704017632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a0705-135b-402a-9bc0-5cfeaf84a018,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:22Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Creating volume 835a0705-135b-402a-9bc0-5cfeaf84a018 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:10:22 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:10:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:22 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 1073741824 Jul 06 10:10:22 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:23 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 1073741824" returned: 0 in 0.940s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:23 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 Jul 06 10:10:23 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:24 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018" returned: 0 in 0.873s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:10:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5c9bef-3e31-4d64-95a8-7833f7d9775d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835a0705-135b-402a-9bc0-5cfeaf84a018', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52ce79c-0c76-4ed3-bc41-8ac87cdd84ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:24 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Volume volume-835a0705-135b-402a-9bc0-5cfeaf84a018 (835a0705-135b-402a-9bc0-5cfeaf84a018): created successfully Jul 06 10:10:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52ce79c-0c76-4ed3-bc41-8ac87cdd84ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (99b9a3a9-9e49-48c9-9405-989ca7ac386c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:24 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fc17c15f-0a96-409e-8b99-40d5aa5cfe7a tempest-VolumesGetTest-1542691028 None] Created volume successfully. Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (8cae1b0c-cdb8-4ff4-b5cd-223ff825b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5057f0f6-43c8-4606-8a26-e40d137a5855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5057f0f6-43c8-4606-8a26-e40d137a5855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1468199312',display_name='tempest-VolumesGetTest-Volume-1921095452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d36944-defd-4c20-9fa3-fe9dd98413b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:27Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f0e7a3-0955-4551-bbfb-119d1b2042e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11f0e7a3-0955-4551-bbfb-119d1b2042e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc67ca2f-c321-4eea-afb8-3c7377216878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc67ca2f-c321-4eea-afb8-3c7377216878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d36944-defd-4c20-9fa3-fe9dd98413b1', 'volume_name': 'volume-27d36944-defd-4c20-9fa3-fe9dd98413b1', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd933e43-e83c-4522-87e1-7596e6803cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd933e43-e83c-4522-87e1-7596e6803cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783fa14f-4d07-46c6-90a1-a37caa859bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:26 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Volume 27d36944-defd-4c20-9fa3-fe9dd98413b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d36944-defd-4c20-9fa3-fe9dd98413b1', 'volume_size': 1} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1468199312',display_name='tempest-VolumesGetTest-Volume-1921095452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d36944-defd-4c20-9fa3-fe9dd98413b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:27Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Creating volume 27d36944-defd-4c20-9fa3-fe9dd98413b1 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:10:26 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:10:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:26 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 1073741824 Jul 06 10:10:26 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Flow 'volume_create_manager' (8ae3c134-9c99-46ea-b759-37bbde9bdaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92e103b-9bc7-48b7-908f-c714bb67108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92e103b-9bc7-48b7-908f-c714bb67108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-35228191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7f663e-36e4-427d-b0c6-1b026ae2a4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6161575064f14ab7a89b08c60e741734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:27Z,use_quota=True,user_id='4034f20746d149a1aaeec47c3c098a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb1776d-d9b7-4d30-a202-3963dd12e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb1776d-d9b7-4d30-a202-3963dd12e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a3736-3131-47a0-a2b6-bffdf10444a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a3736-3131-47a0-a2b6-bffdf10444a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea7f663e-36e4-427d-b0c6-1b026ae2a4cd', 'volume_name': 'volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6726b8f1-0eeb-4c66-8c21-c32d70cc6f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6726b8f1-0eeb-4c66-8c21-c32d70cc6f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1978c2-0fd8-4cb2-b63c-6ebd8c69a656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:27 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Volume ea7f663e-36e4-427d-b0c6-1b026ae2a4cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd', 'volume_size': 1} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:27 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 1073741824" returned: 0 in 0.883s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:27 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 Jul 06 10:10:27 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:28 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1" returned: 0 in 0.698s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-35228191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea7f663e-36e4-427d-b0c6-1b026ae2a4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6161575064f14ab7a89b08c60e741734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:27Z,use_quota=True,user_id='4034f20746d149a1aaeec47c3c098a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Creating volume ea7f663e-36e4-427d-b0c6-1b026ae2a4cd {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:10:28 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783fa14f-4d07-46c6-90a1-a37caa859bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d36944-defd-4c20-9fa3-fe9dd98413b1', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a826584-0fe2-400c-a7d5-fa36368a392f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:28 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd 1073741824 Jul 06 10:10:28 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:28 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Volume volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 (27d36944-defd-4c20-9fa3-fe9dd98413b1): created successfully Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a826584-0fe2-400c-a7d5-fa36368a392f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (8cae1b0c-cdb8-4ff4-b5cd-223ff825b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cd501c8f-d3e0-4644-af31-2939ac7b869e tempest-VolumesGetTest-1542691028 None] Created volume successfully. Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-27d36944-defd-4c20-9fa3-fe9dd98413b1-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Lock "cinder-27d36944-defd-4c20-9fa3-fe9dd98413b1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-27d36944-defd-4c20-9fa3-fe9dd98413b1" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-27d36944-defd-4c20-9fa3-fe9dd98413b1" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:29 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe3781c-5468-4f46-aa09-a5b643653e7f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:29 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 Jul 06 10:10:29 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:29 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd 1073741824" returned: 0 in 1.340s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:29 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd Jul 06 10:10:29 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:30 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1" returned: 0 in 1.096s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:30 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1 Jul 06 10:10:30 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:30 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] <== create_volume: return (2357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1978c2-0fd8-4cb2-b63c-6ebd8c69a656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e4c38e-0bcd-4b29-94b1-e306efd44649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:30 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Volume volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd (ea7f663e-36e4-427d-b0c6-1b026ae2a4cd): created successfully Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e4c38e-0bcd-4b29-94b1-e306efd44649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Flow 'volume_create_manager' (8ae3c134-9c99-46ea-b759-37bbde9bdaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2f45452f-e6ae-40f7-ac5f-db85ca0b4e08 tempest-AttachVolumeTestJSON-1484649718 None] Created volume successfully. Jul 06 10:10:30 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-27d36944-defd-4c20-9fa3-fe9dd98413b1" returned: 0 in 0.866s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-27d36944-defd-4c20-9fa3-fe9dd98413b1" released by "delete_volume" :: held 2.029s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Created reservations ['222d5125-4107-4b11-bc1f-1bee11c10b68', 'a1c971b2-6a4c-4276-98f0-8662097e43d8', 'ac09000c-688f-4753-8f94-e34e6cf1969e', 'e9679c7d-46e7-46fb-a006-65ca70320fa7'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:31 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:10:31 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:32 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.793s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:10:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Deleted volume successfully. Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dca0a882-fe4a-42cb-9393-9786c530fb7e tempest-VolumesGetTest-1542691028 None] Lock "cinder-27d36944-defd-4c20-9fa3-fe9dd98413b1-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-835a0705-135b-402a-9bc0-5cfeaf84a018-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Lock "cinder-835a0705-135b-402a-9bc0-5cfeaf84a018-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-835a0705-135b-402a-9bc0-5cfeaf84a018" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-835a0705-135b-402a-9bc0-5cfeaf84a018" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49d0c04-8773-4a7e-ab9b-0e3407e0d640]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:32 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 Jul 06 10:10:32 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:33 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018" returned: 0 in 0.848s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:33 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018 Jul 06 10:10:33 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:34 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-835a0705-135b-402a-9bc0-5cfeaf84a018" returned: 0 in 0.723s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-835a0705-135b-402a-9bc0-5cfeaf84a018" released by "delete_volume" :: held 1.648s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Created reservations ['49b9d1aa-2aa4-455c-84ca-73be9ec63e3a', 'b82acae0-88c2-498e-beee-b1a3f52a357f', '4b7f92ce-e989-4530-86db-72006902a5f6', 'b15d784b-f32d-4022-bbc7-f749979b67e0'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:34 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:10:34 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-6595ad6e-6e8e-4fac-a4e5-afaa0f0f2367 req-08eb5634-1efe-46b0-b8a5-8619a6c98c2a tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-6595ad6e-6e8e-4fac-a4e5-afaa0f0f2367 req-08eb5634-1efe-46b0-b8a5-8619a6c98c2a tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4112d2f-3308-4cbe-ae04-24e18a499bb2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-6595ad6e-6e8e-4fac-a4e5-afaa0f0f2367 req-08eb5634-1efe-46b0-b8a5-8619a6c98c2a tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:34 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd Jul 06 10:10:34 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:35 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.867s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:10:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Deleted volume successfully. Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4010873e-9219-44fd-ab4f-2ca71727b049 tempest-VolumesGetTest-1542691028 None] Lock "cinder-835a0705-135b-402a-9bc0-5cfeaf84a018-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (cb1980cf-623c-4905-a80c-1319286bdf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c1960f-7824-4549-9998-9a4e8cee9e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c1960f-7824-4549-9998-9a4e8cee9e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-580517560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954d16f4-3451-4b59-87ca-89d964e533bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:35Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b596e-083c-48a6-9249-8e6294ff07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b596e-083c-48a6-9249-8e6294ff07a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0ba09-d675-4b16-8d56-a72a420cf08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0ba09-d675-4b16-8d56-a72a420cf08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954d16f4-3451-4b59-87ca-89d964e533bd', 'volume_name': 'volume-954d16f4-3451-4b59-87ca-89d964e533bd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdfebed-cd0c-47bf-9668-9f022219adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdfebed-cd0c-47bf-9668-9f022219adea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b46858b-912b-408b-b18b-cec927ebcc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:35 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Volume 954d16f4-3451-4b59-87ca-89d964e533bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954d16f4-3451-4b59-87ca-89d964e533bd', 'volume_size': 1} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:35 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-6595ad6e-6e8e-4fac-a4e5-afaa0f0f2367 req-08eb5634-1efe-46b0-b8a5-8619a6c98c2a tempest-AttachVolumeTestJSON-1484649718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd" returned: 0 in 1.013s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-6595ad6e-6e8e-4fac-a4e5-afaa0f0f2367 req-08eb5634-1efe-46b0-b8a5-8619a6c98c2a tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-580517560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954d16f4-3451-4b59-87ca-89d964e533bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:35Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Creating volume 954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:10:35 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:35 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd 1073741824 Jul 06 10:10:35 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-6595ad6e-6e8e-4fac-a4e5-afaa0f0f2367 req-08eb5634-1efe-46b0-b8a5-8619a6c98c2a tempest-AttachVolumeTestJSON-1484649718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cad556f0-c74b-49e5-9316-146d3a308f07', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:10:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-6595ad6e-6e8e-4fac-a4e5-afaa0f0f2367 req-08eb5634-1efe-46b0-b8a5-8619a6c98c2a tempest-AttachVolumeTestJSON-1484649718 None] attachment_update completed successfully. Jul 06 10:10:36 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd 1073741824" returned: 0 in 1.058s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:36 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd Jul 06 10:10:36 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Acquiring lock "cinder-f5aed0ab-c966-4939-ac76-73d13ad98b2d-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "cinder-f5aed0ab-c966-4939-ac76-73d13ad98b2d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Acquiring lock "cinder-quobyte-f5aed0ab-c966-4939-ac76-73d13ad98b2d" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "cinder-quobyte-f5aed0ab-c966-4939-ac76-73d13ad98b2d" acquired by "delete_volume" :: waited 0.048s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[589a769e-591d-4011-83fa-95bf8f4f6e95]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:37 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d Jul 06 10:10:37 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:37 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd" returned: 0 in 0.972s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b46858b-912b-408b-b18b-cec927ebcc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954d16f4-3451-4b59-87ca-89d964e533bd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307ab440-b5f2-4348-b303-b6c22bafaf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Volume volume-954d16f4-3451-4b59-87ca-89d964e533bd (954d16f4-3451-4b59-87ca-89d964e533bd): created successfully Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307ab440-b5f2-4348-b303-b6c22bafaf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (cb1980cf-623c-4905-a80c-1319286bdf7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-95913cb7-e90d-437a-a1e6-79e193e0770c tempest-VolumesGetTest-1542691028 None] Created volume successfully. Jul 06 10:10:38 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d" returned: 0 in 0.888s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:38 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d Jul 06 10:10:38 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:39 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f5aed0ab-c966-4939-ac76-73d13ad98b2d" returned: 0 in 0.855s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "cinder-quobyte-f5aed0ab-c966-4939-ac76-73d13ad98b2d" released by "delete_volume" :: held 1.839s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Created reservations ['117e868b-c2a1-4c3d-9cc8-b6eccbcb14f3', '830f390f-dde3-4df0-99fe-075aa4ec2fa4', '164eed6c-e63f-4e76-a327-1f25f2bc5184', '77f9bdf2-33b7-4b44-bb5e-68371ed377b6'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:39 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:10:39 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (538518c5-1c78-46af-a240-ced63c2f46ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7630a54-75dd-4197-abec-57394b2bb5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7630a54-75dd-4197-abec-57394b2bb5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1959537919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9c05b9-0941-4f62-bb86-8d8aea0fecf8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=954d16f4-3451-4b59-87ca-89d964e533bd,status='creating',terminated_at=None,updated_at=2026-07-06T08:10:39Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4373503c-45a8-4264-b7f6-22113b047167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4373503c-45a8-4264-b7f6-22113b047167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e65353b-fe01-4433-a481-a01419e33091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e65353b-fe01-4433-a481-a01419e33091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dc9c05b9-0941-4f62-bb86-8d8aea0fecf8', 'volume_name': 'volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8', 'volume_size': 1, 'source_volid': '954d16f4-3451-4b59-87ca-89d964e533bd', 'source_volstatus': 'available'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40380b89-6ab9-4785-bfbd-6260e56ad28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40380b89-6ab9-4785-bfbd-6260e56ad28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b91c91-91e1-4437-890c-3a7882a0ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:10:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Volume dc9c05b9-0941-4f62-bb86-8d8aea0fecf8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8', 'volume_size': 1, 'source_volid': '954d16f4-3451-4b59-87ca-89d964e533bd', 'source_volstatus': 'available'} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:39 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Cloning volume 954d16f4-3451-4b59-87ca-89d964e533bd to volume dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Creating offline snapshot c93ea97f-ea36-45a4-9a8e-d47aeb50c777 of volume 954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b85a7-0e4e-48df-9e4a-c0c46eac24cb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:39 devstack sudo[92531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd Jul 06 10:10:39 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:40 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.103s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:40 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:10:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Deleted volume successfully. Jul 06 10:10:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0f5e3deb-5d54-4892-b20b-c236070736d3 tempest-ServerRescueNegativeTestJSON-1063622114 None] Lock "cinder-f5aed0ab-c966-4939-ac76-73d13ad98b2d-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:40 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd" returned: 0 in 1.077s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:40 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 1G Jul 06 10:10:40 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:42 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 1G" returned: 0 in 1.742s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954d16f4-3451-4b59-87ca-89d964e533bd -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:42 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954d16f4-3451-4b59-87ca-89d964e533bd -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 Jul 06 10:10:42 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954d16f4-3451-4b59-87ca-89d964e533bd -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777" returned: 0 in 1.213s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:43 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 is being set with open permissions: ugo+rw Jul 06 10:10:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:43 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:43 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 Jul 06 10:10:43 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:44 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777" returned: 0 in 0.950s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:44 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.info Jul 06 10:10:44 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:45 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.info" returned: 0 in 0.789s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:45 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.info is being set with open permissions: ugo+rw Jul 06 10:10:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:45 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.info Jul 06 10:10:45 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:46 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.info" returned: 0 in 0.835s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] snapshot: c93ea97f-ea36-45a4-9a8e-d47aeb50c777, volume: dc9c05b9-0941-4f62-bb86-8d8aea0fecf8, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b253ace-d0d8-4967-a016-78b70511e868]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:46 devstack sudo[92619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 Jul 06 10:10:46 devstack sudo[92619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:47 devstack sudo[92619]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777" returned: 0 in 0.890s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-954d16f4-3451-4b59-87ca-89d964e533bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:10:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:10:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:10:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f61765-83bd-4c31-b2a9-5acda76cfc44]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:47 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd Jul 06 10:10:47 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:48 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd" returned: 0 in 1.090s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:48 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:10:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:48 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 Jul 06 10:10:48 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:54 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=58,cinder:SELECT=40,cinder:INSERT=14,cinder:DELETE=4 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:10:54 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=43,cinder:UPDATE=47,cinder:INSERT=10,cinder:DELETE=6 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:10:55 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" returned: 0 in 6.885s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba96e20-e982-446c-a1c4-c487f099db7b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:55 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd Jul 06 10:10:55 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-9f2798b7-3a2c-436e-8b88-ccf578ff0fc2 req-43b3ec18-4200-4eb7-ae40-33a340c376fc tempest-AttachVolumeNegativeTest-328973155 None] Terminate volume connection completed successfully. Jul 06 10:10:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-9f2798b7-3a2c-436e-8b88-ccf578ff0fc2 req-43b3ec18-4200-4eb7-ae40-33a340c376fc tempest-AttachVolumeNegativeTest-328973155 None] Deleting attachment 2becd903-8451-4fdd-8db7-3f9a61ac5a3a. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:10:56 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd" returned: 0 in 1.184s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:56 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:10:56 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Converted 1024.00 MB image at 148.69 MB/s Jul 06 10:10:56 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 is being set with open permissions: ugo+rw Jul 06 10:10:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:56 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 Jul 06 10:10:56 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:57 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" returned: 0 in 0.810s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" released by "_copy_volume_from_snapshot" :: held 10.981s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-c93ea97f-ea36-45a4-9a8e-d47aeb50c777" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-c93ea97f-ea36-45a4-9a8e-d47aeb50c777" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Deleting offline snapshot c93ea97f-ea36-45a4-9a8e-d47aeb50c777 of volume 954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] snapshot_file for this snap is: volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b804a798-48d6-4ddf-8172-d7c20e3029ec]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:57 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 Jul 06 10:10:57 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:58 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777" returned: 0 in 0.945s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-954d16f4-3451-4b59-87ca-89d964e533bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c5b13f-abe3-4f36-9fd3-3d4b0f9f9261]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:58 devstack sudo[92802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd Jul 06 10:10:58 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:10:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:59 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:10:59 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:59 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd" returned: 0 in 0.873s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:10:59 devstack sudo[92815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 Jul 06 10:10:59 devstack sudo[92815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:10:59 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Jul 06 10:10:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.986s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:10:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:10:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:10:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:10:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:11:00 devstack sudo[92815]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777" returned: 0 in 0.944s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:00 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777 Jul 06 10:11:00 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:01 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd.c93ea97f-ea36-45a4-9a8e-d47aeb50c777" returned: 0 in 0.806s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-c93ea97f-ea36-45a4-9a8e-d47aeb50c777" released by "_delete_snapshot" :: held 3.683s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.541s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b91c91-91e1-4437-890c-3a7882a0ddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8', 'volume_size': 1, 'source_volid': '954d16f4-3451-4b59-87ca-89d964e533bd', 'source_volstatus': 'available'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cf7e54-7627-4470-9f7b-5008ab7a959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Volume volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 (dc9c05b9-0941-4f62-bb86-8d8aea0fecf8): created successfully Jul 06 10:11:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cf7e54-7627-4470-9f7b-5008ab7a959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (538518c5-1c78-46af-a240-ced63c2f46ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5ee4786b-573c-4065-857c-0839c85c32c0 tempest-VolumesGetTest-1542691028 None] Created volume successfully. Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (cc62363d-c307-4a3b-8b30-11f8c50cd75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae29e9e0-0f05-4e42-bcc3-ebcd8640ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae29e9e0-0f05-4e42-bcc3-ebcd8640ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1382103408',display_name='tempest-VolumesGetTest-Volume-777753317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341785db-4459-4862-b6fe-a4e44d29fbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:03Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23016927-7e6e-4425-990b-011117bc2ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23016927-7e6e-4425-990b-011117bc2ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93257ba-1689-4ca6-939f-b0a1a93bd57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93257ba-1689-4ca6-939f-b0a1a93bd57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341785db-4459-4862-b6fe-a4e44d29fbfa', 'volume_name': 'volume-341785db-4459-4862-b6fe-a4e44d29fbfa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd55e172-f2bf-4951-862e-81c05e5c983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd55e172-f2bf-4951-862e-81c05e5c983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccc7e11-e845-4975-af83-70ee29d877a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:02 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Volume 341785db-4459-4862-b6fe-a4e44d29fbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341785db-4459-4862-b6fe-a4e44d29fbfa', 'volume_size': 1} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1382103408',display_name='tempest-VolumesGetTest-Volume-777753317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341785db-4459-4862-b6fe-a4e44d29fbfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:03Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Creating volume 341785db-4459-4862-b6fe-a4e44d29fbfa {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:02 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:02 devstack sudo[92843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa 1073741824 Jul 06 10:11:02 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:03 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa 1073741824" returned: 0 in 0.907s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:03 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa Jul 06 10:11:03 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:04 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa" returned: 0 in 0.721s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccc7e11-e845-4975-af83-70ee29d877a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341785db-4459-4862-b6fe-a4e44d29fbfa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa981a37-f77d-47c2-b350-561a47f7fa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Volume volume-341785db-4459-4862-b6fe-a4e44d29fbfa (341785db-4459-4862-b6fe-a4e44d29fbfa): created successfully Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa981a37-f77d-47c2-b350-561a47f7fa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (cc62363d-c307-4a3b-8b30-11f8c50cd75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d11aa6d4-42fe-49ad-975f-de23410362a9 tempest-VolumesGetTest-1542691028 None] Created volume successfully. Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-341785db-4459-4862-b6fe-a4e44d29fbfa-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Lock "cinder-341785db-4459-4862-b6fe-a4e44d29fbfa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-341785db-4459-4862-b6fe-a4e44d29fbfa" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-341785db-4459-4862-b6fe-a4e44d29fbfa" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fe6da8-066b-4b55-9e4c-430286009bb0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:05 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa Jul 06 10:11:05 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Flow 'volume_create_manager' (c1f6800b-15ed-4802-866b-f75705da0deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55595d5b-6006-43b3-b4ed-d81c0b80b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55595d5b-6006-43b3-b4ed-d81c0b80b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-758527996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4e5898-610c-4994-b7c6-b89350cf9331,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6944752649746a88ec50ed408391507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:06Z,use_quota=True,user_id='ee268c95d2974895884a43b7080e6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e446f65-410e-4d3d-987b-db53f29148b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e446f65-410e-4d3d-987b-db53f29148b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f75d545-3f0b-4bad-9625-2469a7e693af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:05 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f75d545-3f0b-4bad-9625-2469a7e693af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4e5898-610c-4994-b7c6-b89350cf9331', 'volume_name': 'volume-8d4e5898-610c-4994-b7c6-b89350cf9331', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9865ce-fd9a-4929-8970-4b25de44cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9865ce-fd9a-4929-8970-4b25de44cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2823dd2f-1420-47f0-9e98-4e2eebc8c96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Volume 8d4e5898-610c-4994-b7c6-b89350cf9331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4e5898-610c-4994-b7c6-b89350cf9331', 'volume_size': 1} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-758527996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4e5898-610c-4994-b7c6-b89350cf9331,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6944752649746a88ec50ed408391507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:06Z,use_quota=True,user_id='ee268c95d2974895884a43b7080e6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Creating volume 8d4e5898-610c-4994-b7c6-b89350cf9331 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:05 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa" returned: 0 in 0.852s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:05 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 1073741824 Jul 06 10:11:05 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:05 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa Jul 06 10:11:05 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:06 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-341785db-4459-4862-b6fe-a4e44d29fbfa" returned: 0 in 0.796s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-341785db-4459-4862-b6fe-a4e44d29fbfa" released by "delete_volume" :: held 1.699s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Created reservations ['7dcff097-198a-4f82-8eb2-5831523b2b0a', '65f456d5-6203-436d-806d-ffe35dab04db', 'edcebf9d-9cb9-4b04-a9fa-65e47119f3f8', '4b1d448e-e989-45b3-8b65-89784482a338'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:06 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 1073741824" returned: 0 in 0.988s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:06 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:06 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:06 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 Jul 06 10:11:06 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e19b15-b13f-4751-8798-b1e1d53d3b3a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:07 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 Jul 06 10:11:07 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:07 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.796s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Deleted volume successfully. Jul 06 10:11:07 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3759261-3a92-4c6c-aa7c-f48bd862c51c tempest-VolumesGetTest-1542691028 None] Lock "cinder-341785db-4459-4862-b6fe-a4e44d29fbfa-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2823dd2f-1420-47f0-9e98-4e2eebc8c96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4e5898-610c-4994-b7c6-b89350cf9331', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165f91ad-02e9-45c2-92fc-590d106a9875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:07 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Volume volume-8d4e5898-610c-4994-b7c6-b89350cf9331 (8d4e5898-610c-4994-b7c6-b89350cf9331): created successfully Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165f91ad-02e9-45c2-92fc-590d106a9875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Flow 'volume_create_manager' (c1f6800b-15ed-4802-866b-f75705da0deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3af42185-2722-4976-b9da-9ef9ad996342 tempest-VolumesTestJSON-832952259 None] Created volume successfully. Jul 06 10:11:08 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" returned: 0 in 0.865s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:08 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8 Jul 06 10:11:08 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Flow 'volume_create_manager' (1dc327a9-2570-4331-9fd1-f6559123723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2485b9-e7d3-48c6-adc3-60722fba670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2485b9-e7d3-48c6-adc3-60722fba670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1872479064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24af84f-74b0-4a54-b59c-61ae4bfdaf8f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6944752649746a88ec50ed408391507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:09Z,use_quota=True,user_id='ee268c95d2974895884a43b7080e6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c9ddc-fb83-402b-8ef0-4caa28e61e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67c9ddc-fb83-402b-8ef0-4caa28e61e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a17ba1d-6879-42fa-aed5-1b45d591033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a17ba1d-6879-42fa-aed5-1b45d591033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24af84f-74b0-4a54-b59c-61ae4bfdaf8f', 'volume_name': 'volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67388fcd-3c45-4949-b076-6eb91fed815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67388fcd-3c45-4949-b076-6eb91fed815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059e9fd-86c7-4dac-8fdd-dc19148a6081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:08 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Volume a24af84f-74b0-4a54-b59c-61ae4bfdaf8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f', 'volume_size': 1} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1872479064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24af84f-74b0-4a54-b59c-61ae4bfdaf8f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6944752649746a88ec50ed408391507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:09Z,use_quota=True,user_id='ee268c95d2974895884a43b7080e6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Creating volume a24af84f-74b0-4a54-b59c-61ae4bfdaf8f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:08 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:08 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f 1073741824 Jul 06 10:11:08 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:08 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" returned: 0 in 0.710s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8" released by "delete_volume" :: held 1.629s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Created reservations ['3808dbd7-a14a-43f1-9614-4a97c1d6783e', 'f3457738-137a-462d-bd17-463fc7972e85', 'd8464e45-4e83-4999-8dc1-57cf5735f188', '3a6254ac-c749-4e68-8ebb-646dad79a1c4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:09 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:09 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:09 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f 1073741824" returned: 0 in 0.945s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-954d16f4-3451-4b59-87ca-89d964e533bd-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Lock "cinder-954d16f4-3451-4b59-87ca-89d964e533bd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:09 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f Jul 06 10:11:09 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-954d16f4-3451-4b59-87ca-89d964e533bd" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-954d16f4-3451-4b59-87ca-89d964e533bd" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5211bbd-f0a6-4647-8c42-ff1984b8bdb6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:09 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd Jul 06 10:11:09 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:09 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:09 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Deleted volume successfully. Jul 06 10:11:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6b86014a-f00d-4d4b-ad33-552015a951c0 tempest-VolumesGetTest-1542691028 None] Lock "cinder-dc9c05b9-0941-4f62-bb86-8d8aea0fecf8-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:10 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f" returned: 0 in 0.708s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a059e9fd-86c7-4dac-8fdd-dc19148a6081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe97216d-2d70-4ecc-aebd-55cfad2d610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:10 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Volume volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f (a24af84f-74b0-4a54-b59c-61ae4bfdaf8f): created successfully Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe97216d-2d70-4ecc-aebd-55cfad2d610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Flow 'volume_create_manager' (1dc327a9-2570-4331-9fd1-f6559123723d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4ebc46e5-d9c5-4987-a45f-6b9198f3c62d tempest-VolumesTestJSON-832952259 None] Created volume successfully. Jul 06 10:11:10 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd" returned: 0 in 0.914s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:10 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd Jul 06 10:11:10 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Flow 'volume_create_manager' (e1481bc5-0e30-4cd4-9802-5a7f1ba93ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ccbf32-a707-4770-8946-6a8f3df09869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ccbf32-a707-4770-8946-6a8f3df09869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1729668966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bcc36c-f74a-493d-ae23-8819395ab6ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6944752649746a88ec50ed408391507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:11Z,use_quota=True,user_id='ee268c95d2974895884a43b7080e6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce27251-52cc-4a56-8a45-d094b64d874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce27251-52cc-4a56-8a45-d094b64d874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ef9220-984d-4887-bb56-57e69682c290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ef9220-984d-4887-bb56-57e69682c290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bcc36c-f74a-493d-ae23-8819395ab6ab', 'volume_name': 'volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb5398d-cc4b-4125-91dd-f5e58f58e358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb5398d-cc4b-4125-91dd-f5e58f58e358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30b47c7-162d-4a45-988f-0eb0345e8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:11 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Volume d3bcc36c-f74a-493d-ae23-8819395ab6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab', 'volume_size': 1} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1729668966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bcc36c-f74a-493d-ae23-8819395ab6ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6944752649746a88ec50ed408391507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:11Z,use_quota=True,user_id='ee268c95d2974895884a43b7080e6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Creating volume d3bcc36c-f74a-493d-ae23-8819395ab6ab {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:11 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:11 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab 1073741824 Jul 06 10:11:11 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:11 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-954d16f4-3451-4b59-87ca-89d964e533bd" returned: 0 in 0.721s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-954d16f4-3451-4b59-87ca-89d964e533bd" released by "delete_volume" :: held 1.707s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Created reservations ['cb02a095-ed56-4192-ba1b-4b4e4b5d0715', '27fa4377-42d4-4d54-9d2b-80bf3c2dcb52', '2a09641f-1d4e-41d0-8a43-315aa5a0681e', '024cbf47-a825-40de-98c7-b1a792382425'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:11 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:11 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:12 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.716s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Deleted volume successfully. Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4953cdd1-637f-4c41-b1f2-7cdb685f2170 tempest-VolumesGetTest-1542691028 None] Lock "cinder-954d16f4-3451-4b59-87ca-89d964e533bd-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:12 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab 1073741824" returned: 0 in 1.036s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:12 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab Jul 06 10:11:12 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (d175235f-8000-46de-96e9-c712f2f61020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ab4e3e-2fef-4ce1-ba63-55280f26f883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2ab4e3e-2fef-4ce1-ba63-55280f26f883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-782499327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e0bd35-b12b-4958-ae41-b94e7b462872,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:13Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf15d7b-55a9-4052-9d55-85f26e52c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf15d7b-55a9-4052-9d55-85f26e52c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d55b423-ce69-4c79-8a2c-39eb8680144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:12 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:11:13 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab" returned: 0 in 0.771s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30b47c7-162d-4a45-988f-0eb0345e8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b87be70-c787-45b6-b0d1-b892491772ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d55b423-ce69-4c79-8a2c-39eb8680144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87e0bd35-b12b-4958-ae41-b94e7b462872', 'volume_name': 'volume-87e0bd35-b12b-4958-ae41-b94e7b462872', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660ce2bd-8cd9-4a9b-b532-79a0817cb38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660ce2bd-8cd9-4a9b-b532-79a0817cb38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fb96a7-cd16-4d6c-bedc-86b1e3e1766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:13 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Volume 87e0bd35-b12b-4958-ae41-b94e7b462872: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87e0bd35-b12b-4958-ae41-b94e7b462872', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Trying to clone 87e0bd35-b12b-4958-ae41-b94e7b462872 from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:11:13 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Volume volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab (d3bcc36c-f74a-493d-ae23-8819395ab6ab): created successfully Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b87be70-c787-45b6-b0d1-b892491772ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Flow 'volume_create_manager' (e1481bc5-0e30-4cd4-9802-5a7f1ba93ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-faa9b09d-8161-4646-9303-52bfbb1dfc01 tempest-VolumesTestJSON-832952259 None] Created volume successfully. Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:11:13 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Image download 20.69 MB at 20.69 MB/s Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c46c364-ed15-49e7-b197-e52165441e0c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:13 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD Jul 06 10:11:13 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:14 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:14 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 is fetched for user cb79b746b0d34a5eaf9b63caad47c597. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:11:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6918e32c-8617-4aa9-b60b-0479d87dd846]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:14 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD Jul 06 10:11:14 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Acquiring lock "cinder-d3bcc36c-f74a-493d-ae23-8819395ab6ab-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Lock "cinder-d3bcc36c-f74a-493d-ae23-8819395ab6ab-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Acquiring lock "cinder-quobyte-d3bcc36c-f74a-493d-ae23-8819395ab6ab" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Lock "cinder-quobyte-d3bcc36c-f74a-493d-ae23-8819395ab6ab" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:15 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-782499327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e0bd35-b12b-4958-ae41-b94e7b462872,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:13Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Creating volume 87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:15 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce4dbb1-f820-40bf-be16-418f1c655517]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:15 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 1073741824 Jul 06 10:11:15 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:15 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab Jul 06 10:11:15 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:16 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab" returned: 0 in 0.977s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:16 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab Jul 06 10:11:16 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:16 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 1073741824" returned: 0 in 1.160s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:16 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 Jul 06 10:11:16 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:17 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d3bcc36c-f74a-493d-ae23-8819395ab6ab" returned: 0 in 0.783s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Lock "cinder-quobyte-d3bcc36c-f74a-493d-ae23-8819395ab6ab" released by "delete_volume" :: held 1.824s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Created reservations ['ff8ad636-1e58-419c-bd9c-2ff710647035', 'ab204a1a-7ff6-440f-a941-ab0773c2bee7', '6a157619-0698-4b21-b8ab-a4156bcffa25', '6888714d-1971-489a-8a60-e08f8537b40d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:17 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:17 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:17 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872" returned: 0 in 0.818s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Attempting download of 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume 87e0bd35-b12b-4958-ae41-b94e7b462872. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff09344-8d48-44ab-9d0f-2d6a5b6cdec8]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wz0e9nu2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Acquiring lock "cinder-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Lock "cinder-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Acquiring lock "cinder-quobyte-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Lock "cinder-quobyte-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:17 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wz0e9nu2 Jul 06 10:11:17 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f23ddef-a7c2-4356-8b46-0f82b670d4ff]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:17 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f Jul 06 10:11:17 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:18 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.933s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:18 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Deleted volume successfully. Jul 06 10:11:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e9a2fa6d-d45c-4a28-a175-744b137a05ac tempest-VolumesTestJSON-832952259 None] Lock "cinder-d3bcc36c-f74a-493d-ae23-8819395ab6ab-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:18 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wz0e9nu2" returned: 0 in 0.909s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wz0e9nu2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:18 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wz0e9nu2 Jul 06 10:11:18 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:18 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f" returned: 0 in 0.914s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:18 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f Jul 06 10:11:18 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:19 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wz0e9nu2" returned: 1 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wz0e9nu2' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[906af2ef-d4fa-442b-a957-744b43027954]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:19 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f" returned: 0 in 0.664s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Lock "cinder-quobyte-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f" released by "delete_volume" :: held 1.642s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Created reservations ['6df20fa2-0287-4d41-9ad0-788ea05fa1d0', 'c00330ee-6867-4c06-bbff-b102b45e48b4', 'e9c28f65-1ffd-4be4-af0a-f81dafcc6f6f', 'fe069d83-3821-4356-89a7-879a605d5ffc'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:19 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD Jul 06 10:11:19 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:19 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:19 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Acquiring lock "cinder-8d4e5898-610c-4994-b7c6-b89350cf9331-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Lock "cinder-8d4e5898-610c-4994-b7c6-b89350cf9331-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Acquiring lock "cinder-quobyte-8d4e5898-610c-4994-b7c6-b89350cf9331" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Lock "cinder-quobyte-8d4e5898-610c-4994-b7c6-b89350cf9331" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab6cf63-1ef0-4266-bde6-407e96e469a2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:19 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 Jul 06 10:11:19 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:19 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:19 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] 58ff08d4-fcf7-43ec-b9cb-ad129e740264 was qcow2, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:11:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:20 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 Jul 06 10:11:20 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:20 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.736s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:20 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:20 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Deleted volume successfully. Jul 06 10:11:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-75004037-ed9d-4932-856d-c0ff582f09c2 tempest-VolumesTestJSON-832952259 None] Lock "cinder-a24af84f-74b0-4a54-b59c-61ae4bfdaf8f-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:20 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:20 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331 Jul 06 10:11:20 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:21 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8d4e5898-610c-4994-b7c6-b89350cf9331" returned: 0 in 0.944s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Lock "cinder-quobyte-8d4e5898-610c-4994-b7c6-b89350cf9331" released by "delete_volume" :: held 1.753s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Created reservations ['8dd42871-4f16-4c78-886c-7a3f4b2afb0f', '0ba23ee3-7aef-4285-863e-a8394f260731', 'd6c4fe2d-dcbf-4820-9067-1750515c43bd', 'd868c110-c6f7-41b6-9534-2bcfb8982c52'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:21 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:21 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:22 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.800s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:22 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Deleted volume successfully. Jul 06 10:11:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57c3990f-ded3-4b48-9bd2-cf6708ba75bf tempest-VolumesTestJSON-832952259 None] Lock "cinder-8d4e5898-610c-4994-b7c6-b89350cf9331-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:22 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872" returned: 0 in 2.781s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:22 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_f9t9a6jhdevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:11:22 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Converted 112.00 MB image at 40.24 MB/s Jul 06 10:11:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:22 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 1G Jul 06 10:11:22 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:23 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 1G" returned: 0 in 0.961s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[804fd27f-97dc-49b2-887f-ca9b474d8ed3]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:23 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 Jul 06 10:11:23 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:24 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872" returned: 0 in 1.019s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:24 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 Jul 06 10:11:24 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:25 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872" returned: 1 in 1.011s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:11:25 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Downloaded image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume 87e0bd35-b12b-4958-ae41-b94e7b462872 successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:11:25 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 for user cb79b746b0d34a5eaf9b63caad47c597 is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:11:25 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Marking volume 87e0bd35-b12b-4958-ae41-b94e7b462872 as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:11:25 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Copying metadata from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 to 87e0bd35-b12b-4958-ae41-b94e7b462872. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:11:25 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Creating volume glance metadata for volume 87e0bd35-b12b-4958-ae41-b94e7b462872 backed by image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:11:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fb96a7-cd16-4d6c-bedc-86b1e3e1766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e0bd35-b12b-4958-ae41-b94e7b462872', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a60433-d8e0-41b1-988a-49c8f07a0d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:26 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Volume volume-87e0bd35-b12b-4958-ae41-b94e7b462872 (87e0bd35-b12b-4958-ae41-b94e7b462872): created successfully Jul 06 10:11:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a60433-d8e0-41b1-988a-49c8f07a0d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (d175235f-8000-46de-96e9-c712f2f61020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:26 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5da6f948-95e2-4670-84b8-c27187b61208 tempest-VolumesGetTest-1542691028 None] Created volume successfully. Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (3b63b305-9eab-4569-8bec-55b1688cbe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5cdb7f-c35f-4980-968e-be6a0fb1e193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5cdb7f-c35f-4980-968e-be6a0fb1e193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673020626',display_name='tempest-VolumesGetTest-Volume-45905498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbbbcab-673c-45ed-921f-2f938aac7182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:27Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6affb7-c70e-4ae0-8e75-daf1c50a2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6affb7-c70e-4ae0-8e75-daf1c50a2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191a9c65-6c34-46f8-93f4-a72a374b9163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191a9c65-6c34-46f8-93f4-a72a374b9163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfbbbcab-673c-45ed-921f-2f938aac7182', 'volume_name': 'volume-dfbbbcab-673c-45ed-921f-2f938aac7182', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2719cda-b67a-465f-8abc-fb30ecb0ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2719cda-b67a-465f-8abc-fb30ecb0ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c941c0-312e-4d1e-b311-f34669a635db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:27 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Volume dfbbbcab-673c-45ed-921f-2f938aac7182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfbbbcab-673c-45ed-921f-2f938aac7182', 'volume_size': 1} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-673020626',display_name='tempest-VolumesGetTest-Volume-45905498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbbbcab-673c-45ed-921f-2f938aac7182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='978b6ca61f9945e4947c8054bc187b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:27Z,use_quota=True,user_id='cb79b746b0d34a5eaf9b63caad47c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Creating volume dfbbbcab-673c-45ed-921f-2f938aac7182 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:27 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:27 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 1073741824 Jul 06 10:11:27 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9ea11968-b421-44ac-828f-8dec1b0944d1 tempest-BackendsCapabilitiesAdminTestsJSON-1121151382 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6445007324219, 'free_capacity_gb': 1775.6445007324219, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86456) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 10:11:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-12e78d34-ffd2-4a52-983a-256b8c5be6d7 tempest-BackendsCapabilitiesAdminTestsJSON-1121151382 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6445007324219, 'free_capacity_gb': 1775.6445007324219, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86456) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 10:11:28 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 1073741824" returned: 0 in 0.966s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:28 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 Jul 06 10:11:28 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:29 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182" returned: 0 in 0.750s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c941c0-312e-4d1e-b311-f34669a635db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbbbcab-673c-45ed-921f-2f938aac7182', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b82e73-928c-4298-8aa6-dbe069028a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Volume volume-dfbbbcab-673c-45ed-921f-2f938aac7182 (dfbbbcab-673c-45ed-921f-2f938aac7182): created successfully Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b82e73-928c-4298-8aa6-dbe069028a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Flow 'volume_create_manager' (3b63b305-9eab-4569-8bec-55b1688cbe98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9a8fabbc-e236-4237-8b57-ac8440c02770 tempest-VolumesGetTest-1542691028 None] Created volume successfully. Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-dfbbbcab-673c-45ed-921f-2f938aac7182-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Lock "cinder-dfbbbcab-673c-45ed-921f-2f938aac7182-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-dfbbbcab-673c-45ed-921f-2f938aac7182" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-dfbbbcab-673c-45ed-921f-2f938aac7182" acquired by "delete_volume" :: waited 0.036s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d47ed8-18e4-482c-ab5f-39d43e586b99]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:30 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 Jul 06 10:11:30 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:30 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182" returned: 0 in 1.102s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:31 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182 Jul 06 10:11:31 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:31 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dfbbbcab-673c-45ed-921f-2f938aac7182" returned: 0 in 0.837s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-dfbbbcab-673c-45ed-921f-2f938aac7182" released by "delete_volume" :: held 2.004s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:31 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Created reservations ['f6d4b4f5-c7d4-41ab-b0aa-031e534f3bf9', '6e77286c-d13d-4729-aafc-93162d416e94', '88152702-adf2-4347-bd28-d59dd318724c', '26f35880-e0d6-48ff-bc5e-3a0eb2dcf59b'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:32 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:32 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:32 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.802s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Deleted volume successfully. Jul 06 10:11:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11ae7c6f-4373-4114-82c2-4dbecfcdf194 tempest-VolumesGetTest-1542691028 None] Lock "cinder-dfbbbcab-673c-45ed-921f-2f938aac7182-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-87e0bd35-b12b-4958-ae41-b94e7b462872-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Lock "cinder-87e0bd35-b12b-4958-ae41-b94e7b462872-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Acquiring lock "cinder-quobyte-87e0bd35-b12b-4958-ae41-b94e7b462872" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-87e0bd35-b12b-4958-ae41-b94e7b462872" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c294c9ad-dc37-4b8e-a799-3271c86b3822]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:33 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 Jul 06 10:11:33 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:34 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872" returned: 0 in 0.906s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:34 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 Jul 06 10:11:34 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-20f90e26-0419-4b18-a101-228d79117d66 tempest-GroupsTest-959420521 None] Group tempest-Group1-2020338579: creating Jul 06 10:11:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-20f90e26-0419-4b18-a101-228d79117d66 tempest-GroupsTest-959420521 None] Group tempest-Group1-2020338579: created successfully Jul 06 10:11:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-20f90e26-0419-4b18-a101-228d79117d66 tempest-GroupsTest-959420521 None] Create group completed successfully. Jul 06 10:11:35 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872" returned: 1 in 0.899s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:11:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:35 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872 Jul 06 10:11:35 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:35 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-87e0bd35-b12b-4958-ae41-b94e7b462872" returned: 0 in 0.681s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Lock "cinder-quobyte-87e0bd35-b12b-4958-ae41-b94e7b462872" released by "delete_volume" :: held 2.569s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:35 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Created reservations ['5cf155ef-344f-4eec-a751-f814c286f34c', 'f22bc1a5-3e11-4c86-96b2-b373b9c9c364', 'b738c1ea-9eaf-41aa-984d-eef046633948', 'e1735f8c-1445-45db-bce3-f142d891be3c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:36 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:36 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f0c8da8e-46fc-4765-a928-882968d11245 tempest-GroupsTest-959420521 None] Group tempest-Group2-646117276: creating Jul 06 10:11:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f0c8da8e-46fc-4765-a928-882968d11245 tempest-GroupsTest-959420521 None] Group tempest-Group2-646117276: created successfully Jul 06 10:11:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f0c8da8e-46fc-4765-a928-882968d11245 tempest-GroupsTest-959420521 None] Create group completed successfully. Jul 06 10:11:36 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.645s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Deleted volume successfully. Jul 06 10:11:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-70a5b6e7-324d-4699-99c5-7cd3f343932e tempest-VolumesGetTest-1542691028 None] Lock "cinder-87e0bd35-b12b-4958-ae41-b94e7b462872-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Flow 'volume_create_manager' (6783e0f7-0586-470e-8cc8-1c31777fcd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372db5c2-e249-463c-8b5b-6989c0105d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372db5c2-e249-463c-8b5b-6989c0105d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-670575950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd8fa00b-2d5c-4882-a205-c938adbc57f4,host='devstack@QuobyteHD#QuobyteHD',id=5e12ec10-cc92-4687-8c51-82d2ef2f2281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896eb1fb67df46e9830c3b9b2ad3731a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:38Z,use_quota=True,user_id='9b3e0be6271140558256255bfc4af65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8de27f-155e-4fbd-a7c7-7f2cea8e3983),volume_type_id=2a8de27f-155e-4fbd-a7c7-7f2cea8e3983)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce50901a-da47-4da5-b545-2be163466d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce50901a-da47-4da5-b545-2be163466d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d48cfe7-7876-44fd-9906-39fa0ce591b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d48cfe7-7876-44fd-9906-39fa0ce591b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e12ec10-cc92-4687-8c51-82d2ef2f2281', 'volume_name': 'volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca72f5e-0326-41d0-a51a-61dce0d18ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca72f5e-0326-41d0-a51a-61dce0d18ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7daedcc-9e25-4b28-bd6f-42d040fad28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:38 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Volume 5e12ec10-cc92-4687-8c51-82d2ef2f2281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281', 'volume_size': 1} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dd8fa00b-2d5c-4882-a205-c938adbc57f4,created_at=2026-07-06T08:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-670575950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dd8fa00b-2d5c-4882-a205-c938adbc57f4,host='devstack@QuobyteHD#QuobyteHD',id=5e12ec10-cc92-4687-8c51-82d2ef2f2281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896eb1fb67df46e9830c3b9b2ad3731a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:38Z,use_quota=True,user_id='9b3e0be6271140558256255bfc4af65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a8de27f-155e-4fbd-a7c7-7f2cea8e3983),volume_type_id=2a8de27f-155e-4fbd-a7c7-7f2cea8e3983)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Creating volume 5e12ec10-cc92-4687-8c51-82d2ef2f2281 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:38 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:38 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 1073741824 Jul 06 10:11:38 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:39 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 1073741824" returned: 0 in 0.843s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:39 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 Jul 06 10:11:39 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Flow 'volume_create_manager' (4bfc5e5a-efa8-4c0d-9564-3073d61ea171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cee1616-0171-455b-9f39-67d9cd23de73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cee1616-0171-455b-9f39-67d9cd23de73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-63298694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a349b2-e97d-485b-8124-8b9c3655da9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6642c7d28f04e2ba9b490d773e62b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:40Z,use_quota=True,user_id='e0d226f593b54bca8de281c0c43c4de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f34eadc-567c-4469-a308-7ef1dd531911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f34eadc-567c-4469-a308-7ef1dd531911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5172f953-4437-48fb-ba1f-c232076fb228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5172f953-4437-48fb-ba1f-c232076fb228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a349b2-e97d-485b-8124-8b9c3655da9f', 'volume_name': 'volume-04a349b2-e97d-485b-8124-8b9c3655da9f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69042f71-45da-4a96-a818-b42f9f614c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69042f71-45da-4a96-a818-b42f9f614c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79932ba7-93da-4026-a147-c6fd39afc261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Volume 04a349b2-e97d-485b-8124-8b9c3655da9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a349b2-e97d-485b-8124-8b9c3655da9f', 'volume_size': 1} Jul 06 10:11:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:40 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281" returned: 0 in 0.723s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.230s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-63298694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a349b2-e97d-485b-8124-8b9c3655da9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6642c7d28f04e2ba9b490d773e62b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:40Z,use_quota=True,user_id='e0d226f593b54bca8de281c0c43c4de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Creating volume 04a349b2-e97d-485b-8124-8b9c3655da9f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:40 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:40 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f 1073741824 Jul 06 10:11:40 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7daedcc-9e25-4b28-bd6f-42d040fad28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1735586-9b19-475f-b43c-5d8337565774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:40 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Volume volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 (5e12ec10-cc92-4687-8c51-82d2ef2f2281): created successfully Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1735586-9b19-475f-b43c-5d8337565774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Flow 'volume_create_manager' (6783e0f7-0586-470e-8cc8-1c31777fcd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0763aa70-ee37-42b2-b353-f076c05d2e3d tempest-GroupsTest-959420521 None] Created volume successfully. Jul 06 10:11:41 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f 1073741824" returned: 0 in 1.004s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:41 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f Jul 06 10:11:41 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Acquiring lock "cinder-quobyte-5e12ec10-cc92-4687-8c51-82d2ef2f2281" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Lock "cinder-quobyte-5e12ec10-cc92-4687-8c51-82d2ef2f2281" acquired by "delete_volume" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c32d244-cb07-49d9-8f51-103ac34a46c4]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:41 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 Jul 06 10:11:41 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:41 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f" returned: 0 in 0.770s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79932ba7-93da-4026-a147-c6fd39afc261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a349b2-e97d-485b-8124-8b9c3655da9f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8d4fbb-1ac4-4059-8b5e-b9729a354316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:41 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Volume volume-04a349b2-e97d-485b-8124-8b9c3655da9f (04a349b2-e97d-485b-8124-8b9c3655da9f): created successfully Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8d4fbb-1ac4-4059-8b5e-b9729a354316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Flow 'volume_create_manager' (4bfc5e5a-efa8-4c0d-9564-3073d61ea171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:42 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1e5f449f-9f32-423e-bf8c-38f90e6ead2e tempest-VolumesListTestJSON-1679067843 None] Created volume successfully. Jul 06 10:11:42 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281" returned: 0 in 0.892s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:42 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281 Jul 06 10:11:42 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:43 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5e12ec10-cc92-4687-8c51-82d2ef2f2281" returned: 0 in 0.686s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Lock "cinder-quobyte-5e12ec10-cc92-4687-8c51-82d2ef2f2281" released by "delete_volume" :: held 1.650s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Created reservations ['57e4a8e8-eeb4-4418-a312-8eef3fdcbb4e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:43 devstack cinder-volume[86456]: WARNING cinder.quota [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2025984510 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2025984510, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:11:43 devstack cinder-volume[86456]: WARNING cinder.quota [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2025984510 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2025984510, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Created reservations ['964a73b6-bec5-4d51-b91f-0be97fda6c94', '5cc3a2b2-a56b-45f1-8e16-7c8384a36428', 'c8e57229-fef1-4466-900d-d06cca1016a7', 'b2199279-a06b-42c7-a847-c2f26784e08f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:43 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:43 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Flow 'volume_create_manager' (319afc8a-9829-47b7-bee7-68dc45a3f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dfb48d-ed79-48d2-a314-f8ec1b52eaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dfb48d-ed79-48d2-a314-f8ec1b52eaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-922608010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2269f584-5d5b-4813-ac76-7836565f9241,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6642c7d28f04e2ba9b490d773e62b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:44Z,use_quota=True,user_id='e0d226f593b54bca8de281c0c43c4de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c480699-423c-4d6d-a076-494a98e4c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c480699-423c-4d6d-a076-494a98e4c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcdbcfa-9345-45ae-a5f1-33383990f36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcdbcfa-9345-45ae-a5f1-33383990f36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2269f584-5d5b-4813-ac76-7836565f9241', 'volume_name': 'volume-2269f584-5d5b-4813-ac76-7836565f9241', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dcfd0a-a88a-44d9-9fc0-5662acebd056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7dcfd0a-a88a-44d9-9fc0-5662acebd056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2abac8-b210-451d-8f6a-9dfef74eafa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:43 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Volume 2269f584-5d5b-4813-ac76-7836565f9241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2269f584-5d5b-4813-ac76-7836565f9241', 'volume_size': 1} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-922608010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2269f584-5d5b-4813-ac76-7836565f9241,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6642c7d28f04e2ba9b490d773e62b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:44Z,use_quota=True,user_id='e0d226f593b54bca8de281c0c43c4de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Creating volume 2269f584-5d5b-4813-ac76-7836565f9241 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:43 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:43 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 1073741824 Jul 06 10:11:43 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Created reservations ['f8061ff0-c81d-4ca9-b815-95ac0f93b4cd'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:44 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:44 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:44 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.839s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-390f72cc-70ea-4b3d-afd3-9240480096eb tempest-GroupsTest-959420521 None] Delete group completed successfully. Jul 06 10:11:44 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 1073741824" returned: 0 in 1.037s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:44 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 Jul 06 10:11:44 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:44 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.828s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:44 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6b9d9426-7505-405d-89d8-1a490809a7d5 tempest-GroupsTest-959420521 None] Delete group completed successfully. Jul 06 10:11:45 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241" returned: 0 in 0.691s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd2abac8-b210-451d-8f6a-9dfef74eafa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2269f584-5d5b-4813-ac76-7836565f9241', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ad09c2-50fc-4303-911c-a18e1c45609d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:45 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Volume volume-2269f584-5d5b-4813-ac76-7836565f9241 (2269f584-5d5b-4813-ac76-7836565f9241): created successfully Jul 06 10:11:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ad09c2-50fc-4303-911c-a18e1c45609d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Flow 'volume_create_manager' (319afc8a-9829-47b7-bee7-68dc45a3f57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-134d2efb-b657-46e8-b9c5-8d0d90525fb7 tempest-VolumesListTestJSON-1679067843 None] Created volume successfully. Jul 06 10:11:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c8ec3b3f-f697-4759-ba73-5ee5ee8c653a tempest-GroupsTest-959420521 None] Group tempest-GroupsTest-Group-1552482002: creating Jul 06 10:11:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c8ec3b3f-f697-4759-ba73-5ee5ee8c653a tempest-GroupsTest-959420521 None] Group tempest-GroupsTest-Group-1552482002: created successfully Jul 06 10:11:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c8ec3b3f-f697-4759-ba73-5ee5ee8c653a tempest-GroupsTest-959420521 None] Create group completed successfully. Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Flow 'volume_create_manager' (3776466c-dcdd-4f91-b939-1797caafa397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ce6474-9001-4a11-8679-20b3c6b22d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ce6474-9001-4a11-8679-20b3c6b22d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1314975679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5c56f85-effb-4afb-a141-f56539185389,host='devstack@QuobyteHD#QuobyteHD',id=aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896eb1fb67df46e9830c3b9b2ad3731a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:48Z,use_quota=True,user_id='9b3e0be6271140558256255bfc4af65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44536a8a-351f-4acc-befd-f4784ebdb4da),volume_type_id=44536a8a-351f-4acc-befd-f4784ebdb4da)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a895ca19-0624-41c8-bb39-0f6c17fe81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a895ca19-0624-41c8-bb39-0f6c17fe81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e9555d-e40c-49da-a277-707f7abf902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e9555d-e40c-49da-a277-707f7abf902c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f', 'volume_name': 'volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12589c9e-7e78-45b7-8f08-60b62b0afb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12589c9e-7e78-45b7-8f08-60b62b0afb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8bdde1-8876-49e3-8eef-7880a90dc6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Volume aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f', 'volume_size': 1} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5c56f85-effb-4afb-a141-f56539185389,created_at=2026-07-06T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1314975679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5c56f85-effb-4afb-a141-f56539185389,host='devstack@QuobyteHD#QuobyteHD',id=aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896eb1fb67df46e9830c3b9b2ad3731a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:48Z,use_quota=True,user_id='9b3e0be6271140558256255bfc4af65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44536a8a-351f-4acc-befd-f4784ebdb4da),volume_type_id=44536a8a-351f-4acc-befd-f4784ebdb4da)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Creating volume aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:47 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:47 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f 1073741824 Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Flow 'volume_create_manager' (75ef3dad-e783-4a23-b2e0-e0745f683d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:47 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a70f712-2e3a-432c-ac42-a8129eb038ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a70f712-2e3a-432c-ac42-a8129eb038ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2019892132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0159ca-4049-45eb-90ef-f062b94976ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6642c7d28f04e2ba9b490d773e62b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:48Z,use_quota=True,user_id='e0d226f593b54bca8de281c0c43c4de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84719c5-c8fa-44fa-b92e-11a2f32dcfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84719c5-c8fa-44fa-b92e-11a2f32dcfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35efb93c-81aa-4a97-b536-67999d43c1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35efb93c-81aa-4a97-b536-67999d43c1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd0159ca-4049-45eb-90ef-f062b94976ac', 'volume_name': 'volume-bd0159ca-4049-45eb-90ef-f062b94976ac', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005f5a9f-0a97-4221-a200-fa3c9206e0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (005f5a9f-0a97-4221-a200-fa3c9206e0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b66da93-1e9c-420a-831b-d2e5036a5132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Volume bd0159ca-4049-45eb-90ef-f062b94976ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd0159ca-4049-45eb-90ef-f062b94976ac', 'volume_size': 1} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Flow 'volume_create_manager' (c7c16b6b-b8f1-4228-b32c-981d53eeff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918dc53c-e6ac-4355-8c52-2065120c455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918dc53c-e6ac-4355-8c52-2065120c455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1055386506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37064775-5f6c-4194-b3f4-206ad361935c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be505f3ae384bb1a1ff8b9403de4ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:48Z,use_quota=True,user_id='3d5c7102c83946cfb5f78129023a0683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8427a51-d9bb-432c-8157-190b095264e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8427a51-d9bb-432c-8157-190b095264e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b566f1e4-9cb1-45bb-b236-d75fc1b7843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b566f1e4-9cb1-45bb-b236-d75fc1b7843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37064775-5f6c-4194-b3f4-206ad361935c', 'volume_name': 'volume-37064775-5f6c-4194-b3f4-206ad361935c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba6d919-068f-40b3-ba38-a0a4714a593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba6d919-068f-40b3-ba38-a0a4714a593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b19ac5e-687e-4c87-b07e-2a93f538850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:47 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Volume 37064775-5f6c-4194-b3f4-206ad361935c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37064775-5f6c-4194-b3f4-206ad361935c', 'volume_size': 1} Jul 06 10:11:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:48 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f 1073741824" returned: 0 in 1.008s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:48 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f Jul 06 10:11:48 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:49 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f" returned: 0 in 0.636s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2019892132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0159ca-4049-45eb-90ef-f062b94976ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6642c7d28f04e2ba9b490d773e62b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:48Z,use_quota=True,user_id='e0d226f593b54bca8de281c0c43c4de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Creating volume bd0159ca-4049-45eb-90ef-f062b94976ac {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:49 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8bdde1-8876-49e3-8eef-7880a90dc6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:49 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac 1073741824 Jul 06 10:11:49 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f3d70-a754-4116-902f-8f0dab019f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:49 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Volume volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f (aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f): created successfully Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8f3d70-a754-4116-902f-8f0dab019f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Flow 'volume_create_manager' (3776466c-dcdd-4f91-b939-1797caafa397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8bbd5891-b98d-435a-9de9-56d6d9c87829 tempest-GroupsTest-959420521 None] Created volume successfully. Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Flow 'volume_create_manager' (8eed1131-f56b-4aec-86ba-c0562616cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de3fdac-1b8e-4857-a775-b75c903f44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de3fdac-1b8e-4857-a775-b75c903f44fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1294867217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5c56f85-effb-4afb-a141-f56539185389,host='devstack@QuobyteHD#QuobyteHD',id=dbf37d59-23b1-4223-acc8-62343692135f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896eb1fb67df46e9830c3b9b2ad3731a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:50Z,use_quota=True,user_id='9b3e0be6271140558256255bfc4af65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44536a8a-351f-4acc-befd-f4784ebdb4da),volume_type_id=44536a8a-351f-4acc-befd-f4784ebdb4da)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1b9c85-5a5f-4e16-b00f-d249eb576310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1b9c85-5a5f-4e16-b00f-d249eb576310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ade6351-65a0-4d78-8b9c-5df9aae05dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ade6351-65a0-4d78-8b9c-5df9aae05dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf37d59-23b1-4223-acc8-62343692135f', 'volume_name': 'volume-dbf37d59-23b1-4223-acc8-62343692135f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b77648-1f6a-421c-8319-827d71a663b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b77648-1f6a-421c-8319-827d71a663b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f24423-3a6d-4c05-b644-ca17005c6e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Volume dbf37d59-23b1-4223-acc8-62343692135f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf37d59-23b1-4223-acc8-62343692135f', 'volume_size': 1} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:50 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac 1073741824" returned: 0 in 1.041s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:50 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac Jul 06 10:11:50 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:51 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac" returned: 0 in 0.656s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.257s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1055386506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37064775-5f6c-4194-b3f4-206ad361935c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be505f3ae384bb1a1ff8b9403de4ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:48Z,use_quota=True,user_id='3d5c7102c83946cfb5f78129023a0683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Creating volume 37064775-5f6c-4194-b3f4-206ad361935c {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:51 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:51 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c 1073741824 Jul 06 10:11:51 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b66da93-1e9c-420a-831b-d2e5036a5132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0159ca-4049-45eb-90ef-f062b94976ac', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae2fd1-5b39-40f6-9007-ad95025ab23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:51 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Volume volume-bd0159ca-4049-45eb-90ef-f062b94976ac (bd0159ca-4049-45eb-90ef-f062b94976ac): created successfully Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ae2fd1-5b39-40f6-9007-ad95025ab23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Flow 'volume_create_manager' (75ef3dad-e783-4a23-b2e0-e0745f683d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-760f1139-3733-487b-9b6e-efab68aeafdf tempest-VolumesListTestJSON-1679067843 None] Created volume successfully. Jul 06 10:11:52 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c 1073741824" returned: 0 in 0.884s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:52 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c Jul 06 10:11:52 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:52 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c" returned: 0 in 0.677s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5c56f85-effb-4afb-a141-f56539185389,created_at=2026-07-06T08:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1294867217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5c56f85-effb-4afb-a141-f56539185389,host='devstack@QuobyteHD#QuobyteHD',id=dbf37d59-23b1-4223-acc8-62343692135f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896eb1fb67df46e9830c3b9b2ad3731a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:11:50Z,use_quota=True,user_id='9b3e0be6271140558256255bfc4af65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44536a8a-351f-4acc-befd-f4784ebdb4da),volume_type_id=44536a8a-351f-4acc-befd-f4784ebdb4da)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Creating volume dbf37d59-23b1-4223-acc8-62343692135f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:11:52 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b19ac5e-687e-4c87-b07e-2a93f538850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37064775-5f6c-4194-b3f4-206ad361935c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:52 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f 1073741824 Jul 06 10:11:52 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8c677b-3b26-46fe-b5dc-ca5f68bd180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Volume volume-37064775-5f6c-4194-b3f4-206ad361935c (37064775-5f6c-4194-b3f4-206ad361935c): created successfully Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8c677b-3b26-46fe-b5dc-ca5f68bd180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Flow 'volume_create_manager' (c7c16b6b-b8f1-4228-b32c-981d53eeff95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a83e5f19-2bb6-4097-b4b0-90010e11da32 tempest-AttachVolumeNegativeTest-328973155 None] Created volume successfully. Jul 06 10:11:53 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f 1073741824" returned: 0 in 0.957s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:53 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f Jul 06 10:11:53 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "cinder-bd0159ca-4049-45eb-90ef-f062b94976ac-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-bd0159ca-4049-45eb-90ef-f062b94976ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "cinder-quobyte-bd0159ca-4049-45eb-90ef-f062b94976ac" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-quobyte-bd0159ca-4049-45eb-90ef-f062b94976ac" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3911eba7-d44b-4139-86ac-07bf20df6e87]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:54 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac Jul 06 10:11:54 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:54 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f" returned: 0 in 0.719s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f24423-3a6d-4c05-b644-ca17005c6e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf37d59-23b1-4223-acc8-62343692135f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbf34d3-4cab-489e-ad50-b980e9d41f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:11:54 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Volume volume-dbf37d59-23b1-4223-acc8-62343692135f (dbf37d59-23b1-4223-acc8-62343692135f): created successfully Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbf34d3-4cab-489e-ad50-b980e9d41f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Flow 'volume_create_manager' (8eed1131-f56b-4aec-86ba-c0562616cd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:11:54 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cbfe9a3c-4472-4f72-aa61-62324991417c tempest-GroupsTest-959420521 None] Created volume successfully. Jul 06 10:11:54 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac" returned: 0 in 0.763s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:54 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac Jul 06 10:11:54 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=112,cinder:SELECT=94,cinder:INSERT=34,cinder:DELETE=10 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=98,cinder:UPDATE=138,cinder:DELETE=12,cinder:INSERT=31 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:11:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-34d62d84-847f-49ec-9ac6-4fdaf4d303ba tempest-GroupsTest-959420521 None] Update group completed successfully. Jul 06 10:11:55 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bd0159ca-4049-45eb-90ef-f062b94976ac" returned: 0 in 0.707s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-quobyte-bd0159ca-4049-45eb-90ef-f062b94976ac" released by "delete_volume" :: held 1.515s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Created reservations ['38886eea-1dd8-4e93-91f2-687fbcd0226a', '3f0a658c-e3d4-4de3-b7a0-c3671506ce32', '47aeec71-97dc-4ac9-aac5-c4d788062a2f', '7693b54d-ca49-4284-9658-de5285100c81'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:55 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:55 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "cinder-2269f584-5d5b-4813-ac76-7836565f9241-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-2269f584-5d5b-4813-ac76-7836565f9241-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:56 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-2ea11023-018a-4c2b-ad03-8ebc68f7e8a3 req-bf6e056c-b4cd-4541-8a14-a3d751103c58 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-2ea11023-018a-4c2b-ad03-8ebc68f7e8a3 req-bf6e056c-b4cd-4541-8a14-a3d751103c58 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.686s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "cinder-quobyte-2269f584-5d5b-4813-ac76-7836565f9241" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c7419-e695-4d07-a0d8-fc5992f5ae8e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-2ea11023-018a-4c2b-ad03-8ebc68f7e8a3 req-bf6e056c-b4cd-4541-8a14-a3d751103c58 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Deleted volume successfully. Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-quobyte-2269f584-5d5b-4813-ac76-7836565f9241" acquired by "delete_volume" :: waited 0.053s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fb8a6a71-f17e-4774-a551-b3816cfa2277 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-bd0159ca-4049-45eb-90ef-f062b94976ac-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac377aa-a14c-4daa-9956-c9d847124568]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:56 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c Jul 06 10:11:56 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:56 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 Jul 06 10:11:56 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3737f576-eaae-4ee4-ab04-0ac24f0cfaf8 tempest-GroupsTest-959420521 None] Update group completed successfully. Jul 06 10:11:57 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-2ea11023-018a-4c2b-ad03-8ebc68f7e8a3 req-bf6e056c-b4cd-4541-8a14-a3d751103c58 tempest-AttachVolumeNegativeTest-328973155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c" returned: 0 in 0.800s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-2ea11023-018a-4c2b-ad03-8ebc68f7e8a3 req-bf6e056c-b4cd-4541-8a14-a3d751103c58 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-2ea11023-018a-4c2b-ad03-8ebc68f7e8a3 req-bf6e056c-b4cd-4541-8a14-a3d751103c58 tempest-AttachVolumeNegativeTest-328973155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-37064775-5f6c-4194-b3f4-206ad361935c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c0cc7b7-5d0b-42cc-ba0d-71492e24597e', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:11:57 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-2ea11023-018a-4c2b-ad03-8ebc68f7e8a3 req-bf6e056c-b4cd-4541-8a14-a3d751103c58 tempest-AttachVolumeNegativeTest-328973155 None] attachment_update completed successfully. Jul 06 10:11:57 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241" returned: 0 in 0.867s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:57 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241 Jul 06 10:11:57 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Acquiring lock "cinder-quobyte-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Lock "cinder-quobyte-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bb3817-4929-4c0b-9828-3a74c9ff5558]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:57 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f Jul 06 10:11:57 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:57 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2269f584-5d5b-4813-ac76-7836565f9241" returned: 0 in 0.700s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-quobyte-2269f584-5d5b-4813-ac76-7836565f9241" released by "delete_volume" :: held 1.628s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Created reservations ['7cdcf57c-07f5-4d5a-b630-0a93c3f739a0', '178910bb-7c72-4e2a-917b-895571bd646e', '355b3487-b5ef-49a5-81c6-516467df6448', '171ec97d-9dc8-4f81-b6e7-708347c3ce05'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:58 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:58 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:58 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f" returned: 0 in 0.829s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:58 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f Jul 06 10:11:58 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "cinder-04a349b2-e97d-485b-8124-8b9c3655da9f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-04a349b2-e97d-485b-8124-8b9c3655da9f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "cinder-quobyte-04a349b2-e97d-485b-8124-8b9c3655da9f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-quobyte-04a349b2-e97d-485b-8124-8b9c3655da9f" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ee74c-8d62-402c-a37c-8815db4a2b30]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:58 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.703s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:11:58 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f Jul 06 10:11:58 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Deleted volume successfully. Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ce5ee78-70f5-49b8-a55e-fbdbf9eee299 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-2269f584-5d5b-4813-ac76-7836565f9241-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:11:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:58 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:11:58 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:59 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f" returned: 0 in 0.697s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Lock "cinder-quobyte-aebbb2e5-0722-4cd2-ba91-0a0d0b55c89f" released by "delete_volume" :: held 1.575s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Acquiring lock "cinder-quobyte-dbf37d59-23b1-4223-acc8-62343692135f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Lock "cinder-quobyte-dbf37d59-23b1-4223-acc8-62343692135f" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f860dfa3-fee6-48b7-92ca-80bf636cd90c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:59 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f Jul 06 10:11:59 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:59 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f" returned: 0 in 0.826s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:11:59 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f Jul 06 10:11:59 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:11:59 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:11:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:12:00 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f" returned: 0 in 0.969s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:00 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f Jul 06 10:12:00 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:00 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-04a349b2-e97d-485b-8124-8b9c3655da9f" returned: 0 in 0.725s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-quobyte-04a349b2-e97d-485b-8124-8b9c3655da9f" released by "delete_volume" :: held 1.609s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Created reservations ['93c97ef6-dcec-4871-ab59-6f39238e7a60', 'db02f2da-c7e2-49cf-b7fa-ac319e3e2322', '487758e6-fad5-435a-b2ac-795056e25acc', 'd247f38b-b96d-4bba-a9d0-27daf8ade8d2'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:00 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:12:00 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:00 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dbf37d59-23b1-4223-acc8-62343692135f" returned: 0 in 0.688s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Lock "cinder-quobyte-dbf37d59-23b1-4223-acc8-62343692135f" released by "delete_volume" :: held 1.717s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:00 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Created reservations ['486c43d0-e06c-4ecc-a704-37cd7c4e8cd5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:00 devstack cinder-volume[86456]: WARNING cinder.quota [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-985063444 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-985063444, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:12:00 devstack cinder-volume[86456]: WARNING cinder.quota [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-985063444 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-985063444, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Created reservations ['3a9b7ad9-3d59-43c9-87ed-dd625942ed1e', '634b3eaf-b2c0-4656-ac59-0db70941e120', '78b681bb-bac7-4879-ae51-68f5861dd3bd', '7e1f796f-3bb2-47cf-a60a-00a0abbfe394'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Created reservations ['1fcdc82b-502e-4156-b341-acfa0f4f4bfb', '8dc74526-841e-4a55-8201-294fad39e569', 'ba3eb9e1-65a1-4547-9759-9e91cd26a2e6', '200b183f-3b06-4b39-a59e-5eb5c1ab6a0f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:01 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.905s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:12:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Deleted volume successfully. Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a928494c-e225-484a-b450-3f9ac339b372 tempest-VolumesListTestJSON-1679067843 None] Lock "cinder-04a349b2-e97d-485b-8124-8b9c3655da9f-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:01 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:12:01 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:02 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.795s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:02 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:12:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3ad11d57-46da-4657-9f1a-ce49d47608cb tempest-GroupsTest-959420521 None] Delete group completed successfully. Jul 06 10:12:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-d2a5e0d6-96b4-4dd9-98f3-3319b6ecff11 req-8a8a4810-94d1-4ede-9fe6-35faed790fca tempest-AttachVolumeNegativeTest-328973155 None] Terminate volume connection completed successfully. Jul 06 10:12:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-d2a5e0d6-96b4-4dd9-98f3-3319b6ecff11 req-8a8a4810-94d1-4ede-9fe6-35faed790fca tempest-AttachVolumeNegativeTest-328973155 None] Deleting attachment 2c0cc7b7-5d0b-42cc-ba0d-71492e24597e. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Flow 'volume_create_manager' (ca49dbe9-0f65-48c5-b1ad-a2681e9904bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4038f6d-64cd-4881-b577-881f9e7d0865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4038f6d-64cd-4881-b577-881f9e7d0865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1309416625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ad358-fab1-4836-934a-cd6ea8d2f684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a637cdd48def4635905ea8604cf7c6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:12:05Z,use_quota=True,user_id='55fc6d338aaf48149a11950374e21e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6635d9-3f0d-461c-8221-fb6d2d61f015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6635d9-3f0d-461c-8221-fb6d2d61f015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6ebb42-bc67-4f77-94eb-bc16f6d27007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6ebb42-bc67-4f77-94eb-bc16f6d27007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1ad358-fab1-4836-934a-cd6ea8d2f684', 'volume_name': 'volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e372dd11-380f-49a3-926d-11a6d2b8e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e372dd11-380f-49a3-926d-11a6d2b8e897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e81a974-d2af-4061-bda2-49aa61e80baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684', 'volume_size': 1} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1309416625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ad358-fab1-4836-934a-cd6ea8d2f684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a637cdd48def4635905ea8604cf7c6a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:12:05Z,use_quota=True,user_id='55fc6d338aaf48149a11950374e21e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Creating volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:12:04 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:12:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:04 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 1073741824 Jul 06 10:12:04 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:05 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 1073741824" returned: 0 in 1.002s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:05 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 Jul 06 10:12:05 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:06 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684" returned: 0 in 0.685s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:12:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e81a974-d2af-4061-bda2-49aa61e80baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5954321-c1eb-41b3-a554-d4922fb26d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:06 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Volume volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 (9a1ad358-fab1-4836-934a-cd6ea8d2f684): created successfully Jul 06 10:12:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5954321-c1eb-41b3-a554-d4922fb26d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Flow 'volume_create_manager' (ca49dbe9-0f65-48c5-b1ad-a2681e9904bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:12:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6ddfa83a-53a2-4f2a-8058-8f1ce7bf32d7 tempest-VolumesSnapshotListTestJSON-1125352892 None] Created volume successfully. Jul 06 10:12:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Creating offline snapshot 555721a6-3613-4828-8cdb-f1e3660ebd21 of volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:12:07 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d9927a-aca7-46be-946c-b20113508930]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:07 devstack sudo[93793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 Jul 06 10:12:07 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:08 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684" returned: 0 in 1.018s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:08 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 1G Jul 06 10:12:08 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:09 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 1G" returned: 0 in 1.110s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:09 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 Jul 06 10:12:09 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:09 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21" returned: 0 in 0.763s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:09 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 is being set with open permissions: ugo+rw Jul 06 10:12:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:09 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 Jul 06 10:12:09 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:10 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21" returned: 0 in 0.704s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:10 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.info Jul 06 10:12:10 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:11 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.info" returned: 0 in 0.710s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:11 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.info is being set with open permissions: ugo+rw Jul 06 10:12:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:11 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.info Jul 06 10:12:11 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:12 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.info" returned: 0 in 0.769s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.183s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a31d921d-853e-45fd-98a2-56d478aec5dc tempest-VolumesSnapshotListTestJSON-1125352892 None] Create snapshot completed successfully Jul 06 10:12:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Creating offline snapshot 6a4e302d-0930-4e6d-bfaa-2cda82cbd270 of volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:12:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2741bede-3884-478c-b0a1-0bd203724e3f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:13 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 Jul 06 10:12:13 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:14 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21" returned: 0 in 0.868s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:14 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:12:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:14 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 1G Jul 06 10:12:14 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:15 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 1G" returned: 0 in 1.011s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:15 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 Jul 06 10:12:15 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:16 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270" returned: 0 in 0.839s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:16 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 is being set with open permissions: ugo+rw Jul 06 10:12:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:16 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 Jul 06 10:12:16 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:17 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270" returned: 0 in 0.761s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.625s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-302c9f9c-804e-4d42-9977-da0f70253335 tempest-VolumesSnapshotListTestJSON-1125352892 None] Create snapshot completed successfully Jul 06 10:12:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Creating offline snapshot b2bca827-4cb1-47d0-854b-aea3da9b2675 of volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:12:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2284d4e2-6b95-41a1-9d2c-e7a70950b3ce]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:18 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 Jul 06 10:12:18 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:19 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270" returned: 0 in 0.927s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:12:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:19 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 1G Jul 06 10:12:19 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:20 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 1G" returned: 0 in 1.027s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:20 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 Jul 06 10:12:20 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:20 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675" returned: 0 in 0.741s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:20 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 is being set with open permissions: ugo+rw Jul 06 10:12:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:20 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 Jul 06 10:12:20 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:21 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675" returned: 0 in 0.682s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.481s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5fb4d56d-7a05-49d2-91e0-08d818241638 tempest-VolumesSnapshotListTestJSON-1125352892 None] Create snapshot completed successfully Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-b2bca827-4cb1-47d0-854b-aea3da9b2675-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-b2bca827-4cb1-47d0-854b-aea3da9b2675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-quobyte-b2bca827-4cb1-47d0-854b-aea3da9b2675" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-b2bca827-4cb1-47d0-854b-aea3da9b2675" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Deleting offline snapshot b2bca827-4cb1-47d0-854b-aea3da9b2675 of volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] snapshot_file for this snap is: volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca81115-6b73-4f62-a64f-5f6590e23e58]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:23 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 Jul 06 10:12:23 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:24 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675" returned: 0 in 1.039s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:12:24 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2539892a-85b2-4d22-9bdb-c2fa62d1955b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:24 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 Jul 06 10:12:24 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:25 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270" returned: 0 in 0.963s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:12:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:25 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 Jul 06 10:12:25 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:26 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675" returned: 0 in 0.930s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:26 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675 Jul 06 10:12:26 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:27 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.b2bca827-4cb1-47d0-854b-aea3da9b2675" returned: 0 in 0.686s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-b2bca827-4cb1-47d0-854b-aea3da9b2675" released by "_delete_snapshot" :: held 3.778s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" released by "delete_snapshot" :: held 3.816s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Created reservations ['d426b0e0-52a4-49fd-8ef9-fc1d50e809b0', '2a8b2f1c-2f8c-4446-80e9-040042b656e8', '9d92f8a6-b84b-41f0-a5c2-13ec48e19df5', '1c563492-9dff-4568-b10f-d147cbcce6b1'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:27 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Delete snapshot completed successfully. Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b645f31-58af-4cbc-9282-92122e8f518b tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-b2bca827-4cb1-47d0-854b-aea3da9b2675-delete_snapshot" released by "delete_snapshot" :: held 3.987s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-6a4e302d-0930-4e6d-bfaa-2cda82cbd270-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-6a4e302d-0930-4e6d-bfaa-2cda82cbd270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-quobyte-6a4e302d-0930-4e6d-bfaa-2cda82cbd270" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-6a4e302d-0930-4e6d-bfaa-2cda82cbd270" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Deleting offline snapshot 6a4e302d-0930-4e6d-bfaa-2cda82cbd270 of volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] snapshot_file for this snap is: volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e0301-f256-4a95-bc39-a3d6b6b66b3e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:28 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 Jul 06 10:12:28 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Flow 'volume_create_manager' (b1e312e6-9664-4650-985f-ac0354e620e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15682841-25f0-44f6-8aea-0e37668516af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15682841-25f0-44f6-8aea-0e37668516af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-260556515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9dd55a-555d-4f1c-8bbf-b71da7dab19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b9ace7c3a3488c86294ef757104c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:12:28Z,use_quota=True,user_id='31837ad26a604b8798720bd6f5751a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0a3df9-84f5-4701-8199-9f0da238f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0a3df9-84f5-4701-8199-9f0da238f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147e1ded-6398-4c87-afb4-2f0c676e1498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147e1ded-6398-4c87-afb4-2f0c676e1498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da9dd55a-555d-4f1c-8bbf-b71da7dab19f', 'volume_name': 'volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b87a85e-43a7-420f-a388-1e5d16f7d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b87a85e-43a7-420f-a388-1e5d16f7d64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62582794-19f6-4c82-8905-6593018cfcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:28 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Volume da9dd55a-555d-4f1c-8bbf-b71da7dab19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f', 'volume_size': 1} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-260556515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9dd55a-555d-4f1c-8bbf-b71da7dab19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b9ace7c3a3488c86294ef757104c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:12:28Z,use_quota=True,user_id='31837ad26a604b8798720bd6f5751a0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Creating volume da9dd55a-555d-4f1c-8bbf-b71da7dab19f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:12:28 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:28 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f 1073741824 Jul 06 10:12:28 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:28 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270" returned: 0 in 0.910s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de40074-c602-4689-bc29-384b26f59d5c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:29 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 Jul 06 10:12:29 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:29 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f 1073741824" returned: 0 in 1.281s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:29 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f Jul 06 10:12:29 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:29 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21" returned: 0 in 0.989s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:12:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:29 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 Jul 06 10:12:29 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:30 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f" returned: 0 in 0.715s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62582794-19f6-4c82-8905-6593018cfcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e3e323-4969-4f25-b1f6-fbab252acffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:30 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Volume volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f (da9dd55a-555d-4f1c-8bbf-b71da7dab19f): created successfully Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e3e323-4969-4f25-b1f6-fbab252acffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Flow 'volume_create_manager' (b1e312e6-9664-4650-985f-ac0354e620e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:12:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-93122668-8b66-41f3-af2f-9f7e6e3584cf tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Created volume successfully. Jul 06 10:12:30 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:30 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270 Jul 06 10:12:30 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:31 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.6a4e302d-0930-4e6d-bfaa-2cda82cbd270" returned: 0 in 0.776s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-6a4e302d-0930-4e6d-bfaa-2cda82cbd270" released by "_delete_snapshot" :: held 3.799s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" released by "delete_snapshot" :: held 3.829s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:31 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Created reservations ['5f90ca62-303c-4387-b19c-c2782f8ca983', '22c95c57-6984-4466-86a8-324751de3414', 'de828758-53f8-40d0-bba0-7f8e8af52f51', '5c78ce35-757a-401f-a389-e6eed141fa29'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Delete snapshot completed successfully. Jul 06 10:12:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9de85eaf-9f8e-4adc-b131-0b62723d2022 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-6a4e302d-0930-4e6d-bfaa-2cda82cbd270-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-555721a6-3613-4828-8cdb-f1e3660ebd21-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-555721a6-3613-4828-8cdb-f1e3660ebd21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-quobyte-555721a6-3613-4828-8cdb-f1e3660ebd21" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-555721a6-3613-4828-8cdb-f1e3660ebd21" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Deleting offline snapshot 555721a6-3613-4828-8cdb-f1e3660ebd21 of volume 9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] snapshot_file for this snap is: volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d90eba-a8b1-4525-bc19-4d9c1c00d8cc]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:32 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 Jul 06 10:12:32 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Acquiring lock "cinder-da9dd55a-555d-4f1c-8bbf-b71da7dab19f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "cinder-da9dd55a-555d-4f1c-8bbf-b71da7dab19f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Acquiring lock "cinder-quobyte-da9dd55a-555d-4f1c-8bbf-b71da7dab19f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "cinder-quobyte-da9dd55a-555d-4f1c-8bbf-b71da7dab19f" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6fc6ee-545b-4081-8f95-e54cffd6213b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:33 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f Jul 06 10:12:33 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:33 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21" returned: 0 in 0.951s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:12:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6bff0c-06c1-4e5f-aa0d-8b26b6a28551]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:33 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 Jul 06 10:12:33 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:33 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f" returned: 0 in 1.109s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:34 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f Jul 06 10:12:34 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:34 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684" returned: 0 in 1.136s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:34 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 Jul 06 10:12:34 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:34 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-da9dd55a-555d-4f1c-8bbf-b71da7dab19f" returned: 0 in 0.877s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "cinder-quobyte-da9dd55a-555d-4f1c-8bbf-b71da7dab19f" released by "delete_volume" :: held 2.053s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:34 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Created reservations ['366e4054-e2fa-4c4d-bd7a-00a4e95ef08e', '4ad9019a-5efc-4500-99a5-022d77bc57c9', '20986821-4a0b-4ab3-b43a-3011b38e9133', 'ca2c11db-bf4c-4f4a-ada7-1788b3718353'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:35 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:12:35 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:35 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21" returned: 0 in 1.108s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:35 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21 Jul 06 10:12:35 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:35 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.749s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:12:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Deleted volume successfully. Jul 06 10:12:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f051bad9-4417-4d35-ba47-cb9c9f684eac tempest-VolumeQuotasNegativeTestJSON-1923141458 None] Lock "cinder-da9dd55a-555d-4f1c-8bbf-b71da7dab19f-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:36 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684.555721a6-3613-4828-8cdb-f1e3660ebd21" returned: 0 in 0.735s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-555721a6-3613-4828-8cdb-f1e3660ebd21" released by "_delete_snapshot" :: held 4.127s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" released by "delete_snapshot" :: held 4.163s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:36 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Created reservations ['0a22c3b8-ef51-4c67-8081-5499999c0374', '088cedff-3b48-4059-9f10-2cb3fb346532', '2a54ae33-68e2-4c66-90d4-7b255a3b3442', '418f2120-c511-4118-a043-2a2630cbc0cf'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Delete snapshot completed successfully. Jul 06 10:12:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6bc6bc6-caf2-46d0-bac8-0d4824c8f91f tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-555721a6-3613-4828-8cdb-f1e3660ebd21-delete_snapshot" released by "delete_snapshot" :: held 4.431s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-9a1ad358-fab1-4836-934a-cd6ea8d2f684-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-9a1ad358-fab1-4836-934a-cd6ea8d2f684-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:12:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:12:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c3885d-cc05-44a1-b428-3f3100cecb84]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:12:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:38 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 Jul 06 10:12:38 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:38 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:38 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684 Jul 06 10:12:38 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:39 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9a1ad358-fab1-4836-934a-cd6ea8d2f684" returned: 0 in 0.867s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-quobyte-9a1ad358-fab1-4836-934a-cd6ea8d2f684" released by "delete_volume" :: held 1.902s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Created reservations ['5614ca1d-f2c1-4fe4-9087-7071bc5bad4d', 'bc9b688e-ac13-4875-a822-1b0a24e9776a', '375a0e54-e7b8-439f-8e17-10740a111678', '293052fa-63b0-4f92-90b4-3fdb157db51a'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:39 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:12:39 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:40 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.859s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:40 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:12:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Deleted volume successfully. Jul 06 10:12:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-660ed16e-dde4-4e7d-9ad1-28ae9b75e6c0 tempest-VolumesSnapshotListTestJSON-1125352892 None] Lock "cinder-9a1ad358-fab1-4836-934a-cd6ea8d2f684-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:12:49 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=85,cinder:UPDATE=85,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:12:50 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=90,cinder:SELECT=62,cinder:INSERT=24,cinder:DELETE=7 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Flow 'volume_create_manager' (9cc31797-7554-4d3e-ae15-46fe09e19445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428c0911-23d7-456d-a6c6-cba50f0b77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (428c0911-23d7-456d-a6c6-cba50f0b77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-801338054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781f5d5c-cb7a-4c94-950e-8aa70c271a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be505f3ae384bb1a1ff8b9403de4ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:12:56Z,use_quota=True,user_id='3d5c7102c83946cfb5f78129023a0683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edca7988-22bf-4885-82ec-80add45c3d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edca7988-22bf-4885-82ec-80add45c3d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d562aa63-4347-4956-941e-cb8ceea52cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d562aa63-4347-4956-941e-cb8ceea52cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781f5d5c-cb7a-4c94-950e-8aa70c271a55', 'volume_name': 'volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec37520-ca28-41ca-9121-bbd13b2096e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec37520-ca28-41ca-9121-bbd13b2096e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a44542-9381-4b9b-bf40-225d35351bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:55 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Volume 781f5d5c-cb7a-4c94-950e-8aa70c271a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55', 'volume_size': 1} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-801338054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781f5d5c-cb7a-4c94-950e-8aa70c271a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5be505f3ae384bb1a1ff8b9403de4ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:12:56Z,use_quota=True,user_id='3d5c7102c83946cfb5f78129023a0683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Creating volume 781f5d5c-cb7a-4c94-950e-8aa70c271a55 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:12:55 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:12:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:55 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 1073741824 Jul 06 10:12:55 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:56 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 1073741824" returned: 0 in 1.061s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:57 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 Jul 06 10:12:57 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:57 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55" returned: 0 in 0.889s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a44542-9381-4b9b-bf40-225d35351bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c579b027-fc8c-4f55-96c8-3aa32b538319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:12:57 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Volume volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 (781f5d5c-cb7a-4c94-950e-8aa70c271a55): created successfully Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c579b027-fc8c-4f55-96c8-3aa32b538319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:12:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Flow 'volume_create_manager' (9cc31797-7554-4d3e-ae15-46fe09e19445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:12:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-54e4a340-8374-43dc-8063-6511ca6d39c7 tempest-AttachVolumeNegativeTest-328973155 None] Created volume successfully. Jul 06 10:12:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:12:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:12:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:12:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:12:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:12:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:12:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:12:58 devstack sudo[94151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:12:58 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:12:59 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root Jul 06 10:12:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.884s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:12:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:12:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:12:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:12:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Flow 'volume_create_manager' (893099ff-077d-41ec-afe8-1f39afe43c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba11911-00ea-4054-83f1-cd8bd3987e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba11911-00ea-4054-83f1-cd8bd3987e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1900198980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0595fb05-73cf-4341-98df-319f1cd32a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957c2ddf459e439d94ad40738e096c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:13:02Z,use_quota=True,user_id='e8c842e752f8430ca6b802149dc28d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705c0b8d-86ee-47ba-9ff8-80f4b47bfe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705c0b8d-86ee-47ba-9ff8-80f4b47bfe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3ea6ae-6316-4f08-ab7d-db33feebc31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3ea6ae-6316-4f08-ab7d-db33feebc31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0595fb05-73cf-4341-98df-319f1cd32a01', 'volume_name': 'volume-0595fb05-73cf-4341-98df-319f1cd32a01', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc19698-9844-4060-a55f-b9ce50aee658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc19698-9844-4060-a55f-b9ce50aee658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa74ad83-cfd5-4677-a364-3ba49bf544ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:02 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Volume 0595fb05-73cf-4341-98df-319f1cd32a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0595fb05-73cf-4341-98df-319f1cd32a01', 'volume_size': 1} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1900198980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0595fb05-73cf-4341-98df-319f1cd32a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='957c2ddf459e439d94ad40738e096c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:13:02Z,use_quota=True,user_id='e8c842e752f8430ca6b802149dc28d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Creating volume 0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:13:02 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-33f3af91-6307-44c2-9f77-b65b81938c10 req-3895b5ad-1bdb-47ad-bcb6-891fa8aab80b tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:02 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 1073741824 Jul 06 10:13:02 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:03 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 1073741824" returned: 0 in 1.038s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:03 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:13:03 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:04 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-33f3af91-6307-44c2-9f77-b65b81938c10 req-3895b5ad-1bdb-47ad-bcb6-891fa8aab80b tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.823s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa74ad83-cfd5-4677-a364-3ba49bf544ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0595fb05-73cf-4341-98df-319f1cd32a01', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160f6198-3221-42bb-aa0e-b264088a82d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4014638-e81f-424a-b6f2-713a00f05b44]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-33f3af91-6307-44c2-9f77-b65b81938c10 req-3895b5ad-1bdb-47ad-bcb6-891fa8aab80b tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Volume volume-0595fb05-73cf-4341-98df-319f1cd32a01 (0595fb05-73cf-4341-98df-319f1cd32a01): created successfully Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160f6198-3221-42bb-aa0e-b264088a82d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Flow 'volume_create_manager' (893099ff-077d-41ec-afe8-1f39afe43c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:13:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-135b0225-a336-4cda-91e0-257021e3e17e tempest-VolumesActionsTest-88179739 None] Created volume successfully. Jul 06 10:13:04 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 Jul 06 10:13:04 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:05 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-33f3af91-6307-44c2-9f77-b65b81938c10 req-3895b5ad-1bdb-47ad-bcb6-891fa8aab80b tempest-AttachVolumeNegativeTest-328973155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55" returned: 0 in 0.925s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-33f3af91-6307-44c2-9f77-b65b81938c10 req-3895b5ad-1bdb-47ad-bcb6-891fa8aab80b tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-33f3af91-6307-44c2-9f77-b65b81938c10 req-3895b5ad-1bdb-47ad-bcb6-891fa8aab80b tempest-AttachVolumeNegativeTest-328973155 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '250519c9-43c8-44ee-a16a-b7e8f27daa68', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:13:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-33f3af91-6307-44c2-9f77-b65b81938c10 req-3895b5ad-1bdb-47ad-bcb6-891fa8aab80b tempest-AttachVolumeNegativeTest-328973155 None] attachment_update completed successfully. Jul 06 10:13:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-51f203f8-c6a5-4044-b90b-655722e28025 req-05b557ad-42b5-49c2-913b-9a6583202208 tempest-AttachVolumeNegativeTest-328973155 None] Terminate volume connection completed successfully. Jul 06 10:13:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-51f203f8-c6a5-4044-b90b-655722e28025 req-05b557ad-42b5-49c2-913b-9a6583202208 tempest-AttachVolumeNegativeTest-328973155 None] Deleting attachment 250519c9-43c8-44ee-a16a-b7e8f27daa68. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:13:21 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:13:21 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=7,cinder:SELECT=9,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:13:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e09f0a09-1a00-4d1e-998a-0e33b9241c6b tempest-VolumesActionsTest-88179739 None] Acquiring lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01" by "attach_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e09f0a09-1a00-4d1e-998a-0e33b9241c6b tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01" acquired by "attach_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e09f0a09-1a00-4d1e-998a-0e33b9241c6b tempest-VolumesActionsTest-88179739 None] Attaching volume 0595fb05-73cf-4341-98df-319f1cd32a01 to instance 675db76f-9ca3-4d34-a45f-d5a4b21e2c04 at mountpoint /dev/vdb on host None. Jul 06 10:13:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e09f0a09-1a00-4d1e-998a-0e33b9241c6b tempest-VolumesActionsTest-88179739 None] Attach volume completed successfully. Jul 06 10:13:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e09f0a09-1a00-4d1e-998a-0e33b9241c6b tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01" released by "attach_volume" :: held 0.145s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "cinder-781f5d5c-cb7a-4c94-950e-8aa70c271a55-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-781f5d5c-cb7a-4c94-950e-8aa70c271a55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "cinder-quobyte-781f5d5c-cb7a-4c94-950e-8aa70c271a55" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-quobyte-781f5d5c-cb7a-4c94-950e-8aa70c271a55" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[87977ac2-3be6-4f5b-8046-dffd5d356eff]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d2397a4-791c-496b-afa9-66f41f04e141 tempest-VolumesActionsTest-88179739 None] Acquiring lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-detach_volume" by "detach_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d2397a4-791c-496b-afa9-66f41f04e141 tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8d2397a4-791c-496b-afa9-66f41f04e141 tempest-VolumesActionsTest-88179739 None] Detaching volume 0595fb05-73cf-4341-98df-319f1cd32a01 from instance 675db76f-9ca3-4d34-a45f-d5a4b21e2c04. Jul 06 10:13:23 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 Jul 06 10:13:23 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8d2397a4-791c-496b-afa9-66f41f04e141 tempest-VolumesActionsTest-88179739 None] Detach volume completed successfully. Jul 06 10:13:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d2397a4-791c-496b-afa9-66f41f04e141 tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:24 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55" returned: 0 in 0.778s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:24 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55 Jul 06 10:13:24 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:24 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-781f5d5c-cb7a-4c94-950e-8aa70c271a55" returned: 0 in 0.853s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-quobyte-781f5d5c-cb7a-4c94-950e-8aa70c271a55" released by "delete_volume" :: held 1.712s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Created reservations ['dfc00cba-4350-4957-b68a-c6ab2cafacea', '270fe278-b46d-4f3d-8cce-2ec895b6a4ec', '1915480c-0204-4e84-abc6-5f4377db2ab6', '185ac9ee-d6fd-45dc-b5c1-f43115263f29'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:25 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:13:25 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:25 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.698s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:13:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Deleted volume successfully. Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f0ef5f79-2d3d-498c-ae92-ebd71d7b9dbb tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-781f5d5c-cb7a-4c94-950e-8aa70c271a55-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "cinder-37064775-5f6c-4194-b3f4-206ad361935c-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-37064775-5f6c-4194-b3f4-206ad361935c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "cinder-quobyte-37064775-5f6c-4194-b3f4-206ad361935c" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-quobyte-37064775-5f6c-4194-b3f4-206ad361935c" acquired by "delete_volume" :: waited 0.048s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c925ccbc-523f-46b6-96c1-e7b3e5c42b1b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:13:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:26 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c Jul 06 10:13:26 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:27 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c" returned: 0 in 1.251s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:27 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c Jul 06 10:13:27 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:28 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-37064775-5f6c-4194-b3f4-206ad361935c" returned: 0 in 0.750s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-quobyte-37064775-5f6c-4194-b3f4-206ad361935c" released by "delete_volume" :: held 2.072s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Created reservations ['ddb3244a-78c9-4680-947d-7e3b4c794ec5', '90a40223-b25b-4c63-880c-9d175a1ceb0f', '928a03e5-4601-424c-9b32-bbf04b9066af', '99404e20-ec63-40ff-9959-8298c508e9b1'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:28 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:13:28 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:29 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.752s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:13:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Deleted volume successfully. Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-25083410-9a83-4d95-872f-061591dc35c8 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-37064775-5f6c-4194-b3f4-206ad361935c-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "cinder-d719c4a1-d147-4322-8709-85993d1cb385-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-d719c4a1-d147-4322-8709-85993d1cb385-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "cinder-quobyte-d719c4a1-d147-4322-8709-85993d1cb385" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-quobyte-d719c4a1-d147-4322-8709-85993d1cb385" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c768a-b5cd-4b79-a2da-d0f84332c054]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:13:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:30 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 Jul 06 10:13:30 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:30 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385" returned: 0 in 0.899s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:30 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385 Jul 06 10:13:30 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:31 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d719c4a1-d147-4322-8709-85993d1cb385" returned: 0 in 0.768s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-quobyte-d719c4a1-d147-4322-8709-85993d1cb385" released by "delete_volume" :: held 1.748s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Created reservations ['49001c1e-23e8-4149-8b8b-a6321a689673', '5d38ddb9-8fc5-4654-b404-c2a8356c0dc6', '02be1b13-bc8f-4795-b328-a9a633ba1151', 'ce1b19cb-0007-423e-9998-8c512475922e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:31 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:13:31 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:33 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.341s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:33 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:13:33 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Deleted volume successfully. Jul 06 10:13:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f51af75b-9a4a-4819-89db-1c959fcf98c7 tempest-AttachVolumeNegativeTest-328973155 None] Lock "cinder-d719c4a1-d147-4322-8709-85993d1cb385-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8adc6c46-52de-4ec1-af1e-d4675d8f84b0 tempest-GroupSnapshotsTest-1376314478 None] Group tempest-GroupSnapshotsTest-Group-1836933203: creating Jul 06 10:13:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8adc6c46-52de-4ec1-af1e-d4675d8f84b0 tempest-GroupSnapshotsTest-1376314478 None] Group tempest-GroupSnapshotsTest-Group-1836933203: created successfully Jul 06 10:13:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8adc6c46-52de-4ec1-af1e-d4675d8f84b0 tempest-GroupSnapshotsTest-1376314478 None] Create group completed successfully. Jul 06 10:13:42 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (1f79dbda-9d8a-42bd-8769-97ad07fcb729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a216ba-c9fa-4577-a995-0cc5cef8d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a216ba-c9fa-4577-a995-0cc5cef8d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707818317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a1abfca-f496-43b6-b0fc-6876053d7912,host='devstack@QuobyteHD#QuobyteHD',id=8c15fa89-6cc5-45e2-88b5-5cc6d777a11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:13:43Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53504d80-e725-4761-9365-76d4bd2d85d1),volume_type_id=53504d80-e725-4761-9365-76d4bd2d85d1)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc82fdc8-e980-46a7-9ae9-46d2e3f8766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc82fdc8-e980-46a7-9ae9-46d2e3f8766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23847020-dfbe-4f7c-90ba-7be568500eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23847020-dfbe-4f7c-90ba-7be568500eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c15fa89-6cc5-45e2-88b5-5cc6d777a11f', 'volume_name': 'volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcad9694-d147-4dfa-93e1-20af6a1dc9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcad9694-d147-4dfa-93e1-20af6a1dc9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfc8c32-c7d5-46d8-9288-dd40e2585187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:43 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Volume 8c15fa89-6cc5-45e2-88b5-5cc6d777a11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f', 'volume_size': 1} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a1abfca-f496-43b6-b0fc-6876053d7912,created_at=2026-07-06T08:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-707818317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a1abfca-f496-43b6-b0fc-6876053d7912,host='devstack@QuobyteHD#QuobyteHD',id=8c15fa89-6cc5-45e2-88b5-5cc6d777a11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:13:43Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53504d80-e725-4761-9365-76d4bd2d85d1),volume_type_id=53504d80-e725-4761-9365-76d4bd2d85d1)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Creating volume 8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:13:43 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:43 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f 1073741824 Jul 06 10:13:43 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:43 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f 1073741824" returned: 0 in 0.808s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:43 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f Jul 06 10:13:43 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:44 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" returned: 0 in 0.802s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:13:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:44 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbfc8c32-c7d5-46d8-9288-dd40e2585187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:44 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7e6756-4bb5-4c8a-ac1d-5d616ad82808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:44 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Volume volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f (8c15fa89-6cc5-45e2-88b5-5cc6d777a11f): created successfully Jul 06 10:13:44 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7e6756-4bb5-4c8a-ac1d-5d616ad82808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:44 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (1f79dbda-9d8a-42bd-8769-97ad07fcb729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:13:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9847c90f-4f2e-42f5-95b3-94ec21778841 tempest-GroupSnapshotsTest-1376314478 None] Created volume successfully. Jul 06 10:13:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] GroupSnapshot ca44082d-02d1-4eb5-960d-459ca0f6c5fd: creating. Jul 06 10:13:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Group snapshot ca44082d-02d1-4eb5-960d-459ca0f6c5fd: creating. {{(pid=86456) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 10:13:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Creating offline snapshot c0b91825-e101-4171-b67e-fedf2fe556f6 of volume 8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:13:45 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ad4b59-170a-4647-88f5-abc22b243409]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:13:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:45 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f Jul 06 10:13:45 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:46 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" returned: 0 in 0.874s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:46 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 1G Jul 06 10:13:46 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:47 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 1G" returned: 0 in 0.908s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:47 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 Jul 06 10:13:47 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:48 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6" returned: 0 in 0.920s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:48 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:13:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:48 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 Jul 06 10:13:48 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11fc2ebd-1348-4e6a-9745-4b8a95ffe6e0 tempest-VolumesActionsTest-88179739 None] Acquiring lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01" by "attach_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11fc2ebd-1348-4e6a-9745-4b8a95ffe6e0 tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01" acquired by "attach_volume" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:48 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-11fc2ebd-1348-4e6a-9745-4b8a95ffe6e0 tempest-VolumesActionsTest-88179739 None] Attaching volume 0595fb05-73cf-4341-98df-319f1cd32a01 to instance a2185229-9510-4bfe-9463-f77670de26fc at mountpoint /dev/vdb on host None. Jul 06 10:13:48 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-11fc2ebd-1348-4e6a-9745-4b8a95ffe6e0 tempest-VolumesActionsTest-88179739 None] Attach volume completed successfully. Jul 06 10:13:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11fc2ebd-1348-4e6a-9745-4b8a95ffe6e0 tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01" released by "attach_volume" :: held 0.203s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:49 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:49 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.info Jul 06 10:13:49 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-842ad623-9641-41cb-98f4-c220f3f2a6dc tempest-VolumesActionsTest-88179739 None] Acquiring lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-detach_volume" by "detach_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-842ad623-9641-41cb-98f4-c220f3f2a6dc tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-842ad623-9641-41cb-98f4-c220f3f2a6dc tempest-VolumesActionsTest-88179739 None] Detaching volume 0595fb05-73cf-4341-98df-319f1cd32a01 from instance a2185229-9510-4bfe-9463-f77670de26fc. Jul 06 10:13:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-842ad623-9641-41cb-98f4-c220f3f2a6dc tempest-VolumesActionsTest-88179739 None] Detach volume completed successfully. Jul 06 10:13:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-842ad623-9641-41cb-98f4-c220f3f2a6dc tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:13:50 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.info" returned: 0 in 0.817s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:50 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:13:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:50 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.info Jul 06 10:13:50 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:50 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.info" returned: 0 in 0.699s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.109s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:50 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2206669c-8a71-438a-bfd7-a2b368367d27 tempest-GroupSnapshotsTest-1376314478 None] group_snapshot ca44082d-02d1-4eb5-960d-459ca0f6c5fd: created successfully Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-c0b91825-e101-4171-b67e-fedf2fe556f6-6ec29cea-1ae1-4656-9341-f74640049318" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-c0b91825-e101-4171-b67e-fedf2fe556f6-6ec29cea-1ae1-4656-9341-f74640049318" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Creating volume 6ec29cea-1ae1-4656-9341-f74640049318 from snapshot c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-6ec29cea-1ae1-4656-9341-f74640049318" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6ec29cea-1ae1-4656-9341-f74640049318" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] snapshot: c0b91825-e101-4171-b67e-fedf2fe556f6, volume: 6ec29cea-1ae1-4656-9341-f74640049318, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[697592a7-cc3a-4cd8-97e4-6ae6d8ae176e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:13:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:53 devstack sudo[95090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 Jul 06 10:13:53 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:54 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6" returned: 0 in 0.860s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b6c38-f8e8-47af-b5f2-563be682246b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:54 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f Jul 06 10:13:54 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Flow 'volume_create_manager' (8a9fba68-4056-48bc-ba4a-4ab4fc570f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6242e128-8810-4870-8e90-e1b6df157c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6242e128-8810-4870-8e90-e1b6df157c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1694300326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861969d5-38bb-416d-9cd2-77ccdfca1d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e761f85efac499b843b6de1c228ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:13:55Z,use_quota=True,user_id='d82fa0e2d2df45179769b8233520fd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc69ce82-20fc-4753-8d4d-f522c940e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc69ce82-20fc-4753-8d4d-f522c940e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5ee92c-7995-49d0-b97a-475add35e42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5ee92c-7995-49d0-b97a-475add35e42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861969d5-38bb-416d-9cd2-77ccdfca1d9b', 'volume_name': 'volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea2346e-f7de-4eff-80cb-09b0f5378221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea2346e-f7de-4eff-80cb-09b0f5378221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d4dca2-2f94-4a53-952a-7c4452a0ca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:13:54 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Volume 861969d5-38bb-416d-9cd2-77ccdfca1d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b', 'volume_size': 1} Jul 06 10:13:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:55 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 06 10:13:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" returned: 0 in 0.840s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:13:55 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:13:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:55 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 Jul 06 10:13:55 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:13:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:13:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:13:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:13:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:13:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:13:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:13:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:13:59 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:13:59 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:00 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.154s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:14:00 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318" returned: 0 in 5.464s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0edb7c8-7cf5-445a-a26c-7d5574507552]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:00 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f Jul 06 10:14:00 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:01 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" returned: 0 in 0.923s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:01 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:14:01 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Converted 1024.00 MB image at 187.39 MB/s Jul 06 10:14:01 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:14:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:01 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 Jul 06 10:14:01 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:02 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318" returned: 0 in 0.660s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6ec29cea-1ae1-4656-9341-f74640049318" released by "_copy_volume_from_snapshot" :: held 8.876s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-c0b91825-e101-4171-b67e-fedf2fe556f6-6ec29cea-1ae1-4656-9341-f74640049318" released by "_create_volume_from_snapshot" :: held 8.929s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.964s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.612s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1694300326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861969d5-38bb-416d-9cd2-77ccdfca1d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e761f85efac499b843b6de1c228ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:13:55Z,use_quota=True,user_id='d82fa0e2d2df45179769b8233520fd72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Creating volume 861969d5-38bb-416d-9cd2-77ccdfca1d9b {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:14:02 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:14:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:02 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b 1073741824 Jul 06 10:14:02 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8a641f01-1a12-4719-b0dd-0890fba3b501 tempest-GroupSnapshotsTest-1376314478 None] Create group from source-snapshot-ca44082d-02d1-4eb5-960d-459ca0f6c5fd completed successfully. Jul 06 10:14:03 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b 1073741824" returned: 0 in 0.869s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:03 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b Jul 06 10:14:03 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-6ec29cea-1ae1-4656-9341-f74640049318" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6ec29cea-1ae1-4656-9341-f74640049318" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[007e8dd2-940d-4a91-b597-4476a46aa7ef]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:03 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 Jul 06 10:14:03 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:03 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b" returned: 0 in 0.737s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.474s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d4dca2-2f94-4a53-952a-7c4452a0ca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06dc48a-0787-4ffa-a876-27e5824bdc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7923e9a-6309-41ff-ab4e-603280f16afc]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Volume volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b (861969d5-38bb-416d-9cd2-77ccdfca1d9b): created successfully Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06dc48a-0787-4ffa-a876-27e5824bdc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Flow 'volume_create_manager' (8a9fba68-4056-48bc-ba4a-4ab4fc570f27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:14:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-66cbab37-8a8b-4b6c-a93f-3ab2d4cce074 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Created volume successfully. Jul 06 10:14:04 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:04 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:04 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318" returned: 0 in 0.854s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:04 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318 Jul 06 10:14:04 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-d9cff8ea-b273-43ce-bf30-8ed7a8d22b1c req-c711f285-609f-4a84-b9ac-b04e7b7f6a40 tempest-AttachVolumeTestJSON-1484649718 None] Terminate volume connection completed successfully. Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-d9cff8ea-b273-43ce-bf30-8ed7a8d22b1c req-c711f285-609f-4a84-b9ac-b04e7b7f6a40 tempest-AttachVolumeTestJSON-1484649718 None] Deleting attachment cad556f0-c74b-49e5-9316-146d3a308f07. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:14:04 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 0.836s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b7ed9-4717-4694-9bcf-f27b3e21e9db]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:04 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6ec29cea-1ae1-4656-9341-f74640049318" returned: 0 in 0.700s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6ec29cea-1ae1-4656-9341-f74640049318" released by "delete_volume" :: held 1.600s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:04 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:04 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['1747eade-be21-4f3f-9ffc-12b813aa923c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:14:05 devstack cinder-volume[86456]: WARNING cinder.quota [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1123666799 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1123666799, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:14:05 devstack cinder-volume[86456]: WARNING cinder.quota [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1123666799 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1123666799, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['77c65b86-e8bc-4daa-afab-37697a11995f', 'b1d607b2-529a-4210-878c-e8574a38709b', 'c4422ff7-2445-41f4-94a1-5ed38e6f89f7', 'd1d77924-ba85-42a8-82a6-8088bdc8138d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:05 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:14:05 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:05 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 0.737s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.1464fc84-fede-43ca-ac80-f4f7f86184fdg8ssmrc1.img {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:05 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.1464fc84-fede-43ca-ac80-f4f7f86184fdg8ssmrc1.img Jul 06 10:14:05 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:05 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.659s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:14:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8a9d7f8b-4851-465f-98be-b72eeb4157e6 tempest-GroupSnapshotsTest-1376314478 None] Delete group completed successfully. Jul 06 10:14:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] group_snapshot ca44082d-02d1-4eb5-960d-459ca0f6c5fd: deleting Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] group_snapshot ca44082d-02d1-4eb5-960d-459ca0f6c5fd: deleting {{(pid=86456) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-c0b91825-e101-4171-b67e-fedf2fe556f6" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-c0b91825-e101-4171-b67e-fedf2fe556f6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Deleting offline snapshot c0b91825-e101-4171-b67e-fedf2fe556f6 of volume 8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] snapshot_file for this snap is: volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd88b93-994f-4133-927e-2d92fcec218b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:06 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 Jul 06 10:14:06 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:07 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6" returned: 0 in 1.221s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:14:07 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e68a10-b22f-4c5b-b9d2-ea97c10192cb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:07 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f Jul 06 10:14:07 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-f70ff4f1-58d9-47ac-b95d-7d4632f26eb6 req-e523fb08-8def-460a-8a99-841562538fa2 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:08 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" returned: 0 in 1.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:09 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 Jul 06 10:14:09 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:10 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6" returned: 0 in 1.464s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:10 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6 Jul 06 10:14:10 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:11 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.1464fc84-fede-43ca-ac80-f4f7f86184fdg8ssmrc1.img" returned: 0 in 5.695s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66ecbb4-eb3d-4ee1-9bff-b1b4b73c15ef]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:11 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:11 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:11 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f.c0b91825-e101-4171-b67e-fedf2fe556f6" returned: 0 in 1.241s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-c0b91825-e101-4171-b67e-fedf2fe556f6" released by "_delete_snapshot" :: held 5.805s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" released by "delete_snapshot" :: held 5.832s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:11 devstack cinder-volume[86456]: WARNING cinder.quota [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1123666799 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1123666799, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:14:11 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['ce347945-93ca-4dc8-bfac-7aa3edcdb685', 'b88a44d3-b380-40e8-a465-7e2e172530dc', 'c3960a96-db40-40ea-aea4-86beac76fb0b', 'cf7e74d0-e968-410c-9888-9fbb0877db4f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:14:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-978d2da0-854d-4f86-b1cb-591bfd3b7def tempest-GroupSnapshotsTest-1376314478 None] group_snapshot ca44082d-02d1-4eb5-960d-459ca0f6c5fd: deleted successfully Jul 06 10:14:12 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 1.002s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:12 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.1464fc84-fede-43ca-ac80-f4f7f86184fdg8ssmrc1.img {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:14:12 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Converted 1024.00 MB image at 179.78 MB/s Jul 06 10:14:12 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] 1464fc84-fede-43ca-ac80-f4f7f86184fd was raw, no need to convert to raw {{(pid=86456) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 10:14:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c317440-044a-4f9e-8ae7-75c8fdde1df5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:12 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f Jul 06 10:14:12 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:13 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" returned: 0 in 0.828s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:13 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f Jul 06 10:14:13 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:14 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" returned: 0 in 0.667s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-8c15fa89-6cc5-45e2-88b5-5cc6d777a11f" released by "delete_volume" :: held 1.571s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['aaef9eca-605b-4e07-a604-5bb7bd6e8dc8'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:14:14 devstack cinder-volume[86456]: WARNING cinder.db.api [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1123666799'] Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['510f64d5-bf58-47d0-bfb9-0d33e314c440', '7d5e4c6c-d6ed-4865-94cf-881efc50a4ec', 'a834813e-dd5d-46b4-a106-c63d1404fbd3', 'ba20746e-8fdc-4bed-9278-343e406c6607'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:14 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:14:14 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:15 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:15 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:14:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-aa3adad8-bec5-4bf1-94cd-4ce61b672d08 tempest-GroupSnapshotsTest-1376314478 None] Delete group completed successfully. Jul 06 10:14:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f67f7661-5463-4042-b96b-9647d9a5d549 tempest-GroupSnapshotsTest-1376314478 None] Group tempest-GroupSnapshotsTest-Group-1415853995: creating Jul 06 10:14:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f67f7661-5463-4042-b96b-9647d9a5d549 tempest-GroupSnapshotsTest-1376314478 None] Group tempest-GroupSnapshotsTest-Group-1415853995: created successfully Jul 06 10:14:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f67f7661-5463-4042-b96b-9647d9a5d549 tempest-GroupSnapshotsTest-1376314478 None] Create group completed successfully. Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (26c9536e-3cf9-4ff6-9a9a-7395660de4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d117fb3-16fe-4ce4-872a-a537ed42cc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d117fb3-16fe-4ce4-872a-a537ed42cc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-598394573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42882e32-c88f-4bee-993e-a80fd1b0046e,host='devstack@QuobyteHD#QuobyteHD',id=6074c4dd-c9d1-46be-989d-6119433c5cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:14:18Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9850cd-30f5-4cf0-9175-e74e528a96b5),volume_type_id=3f9850cd-30f5-4cf0-9175-e74e528a96b5)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cc3be0-61b0-4fa8-befe-db33a94c304b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cc3be0-61b0-4fa8-befe-db33a94c304b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cafa0f-8354-4535-b1d2-8b03e92b5a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cafa0f-8354-4535-b1d2-8b03e92b5a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6074c4dd-c9d1-46be-989d-6119433c5cf5', 'volume_name': 'volume-6074c4dd-c9d1-46be-989d-6119433c5cf5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f43d74-e144-4bec-884f-774652e7d686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f43d74-e144-4bec-884f-774652e7d686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3a4481-b598-4d38-8935-41f1bbd60eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:17 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Volume 6074c4dd-c9d1-46be-989d-6119433c5cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6074c4dd-c9d1-46be-989d-6119433c5cf5', 'volume_size': 1} Jul 06 10:14:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:27 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=68,cinder:INSERT=16,cinder:UPDATE=75,cinder:DELETE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:14:27 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=80,cinder:INSERT=17,cinder:UPDATE=64,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:14:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.258s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Uploaded volume to glance image-id: 1464fc84-fede-43ca-ac80-f4f7f86184fd. {{(pid=86456) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 10:14:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-f70ff4f1-58d9-47ac-b95d-7d4632f26eb6 req-e523fb08-8def-460a-8a99-841562538fa2 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.837s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d963b3-1b8e-4bdc-a780-565fc893c7fb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-f70ff4f1-58d9-47ac-b95d-7d4632f26eb6 req-e523fb08-8def-460a-8a99-841562538fa2 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-16e17c49-0f83-4b81-8b93-78de9777c33e tempest-VolumesActionsTest-88179739 None] Copy volume to image completed successfully. Jul 06 10:14:34 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b Jul 06 10:14:34 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:35 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-f70ff4f1-58d9-47ac-b95d-7d4632f26eb6 req-e523fb08-8def-460a-8a99-841562538fa2 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b" returned: 0 in 1.027s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-f70ff4f1-58d9-47ac-b95d-7d4632f26eb6 req-e523fb08-8def-460a-8a99-841562538fa2 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.046s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.582s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42882e32-c88f-4bee-993e-a80fd1b0046e,created_at=2026-07-06T08:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-598394573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42882e32-c88f-4bee-993e-a80fd1b0046e,host='devstack@QuobyteHD#QuobyteHD',id=6074c4dd-c9d1-46be-989d-6119433c5cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:14:18Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9850cd-30f5-4cf0-9175-e74e528a96b5),volume_type_id=3f9850cd-30f5-4cf0-9175-e74e528a96b5)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Creating volume 6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:14:35 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:35 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 1073741824 Jul 06 10:14:35 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-f70ff4f1-58d9-47ac-b95d-7d4632f26eb6 req-e523fb08-8def-460a-8a99-841562538fa2 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d2dcffe-c228-493b-8286-f7c6457aa8c9', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:14:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-f70ff4f1-58d9-47ac-b95d-7d4632f26eb6 req-e523fb08-8def-460a-8a99-841562538fa2 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] attachment_update completed successfully. Jul 06 10:14:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:36 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 1073741824" returned: 0 in 1.375s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:36 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 Jul 06 10:14:36 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:37 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5" returned: 0 in 0.784s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] <== create_volume: return (2221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.963s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eba07f-8514-4a91-85d9-2fab60664828]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3a4481-b598-4d38-8935-41f1bbd60eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6074c4dd-c9d1-46be-989d-6119433c5cf5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed21784-96d5-42d7-a3ed-11729b3f982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Volume volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 (6074c4dd-c9d1-46be-989d-6119433c5cf5): created successfully Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed21784-96d5-42d7-a3ed-11729b3f982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (26c9536e-3cf9-4ff6-9a9a-7395660de4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:14:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-62da6cfd-d755-4c20-818a-8b15ac84cbe5 tempest-GroupSnapshotsTest-1376314478 None] Created volume successfully. Jul 06 10:14:37 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:37 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:38 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 0.827s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a40a76e-46bd-48fc-b328-f32a0c91b198]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:38 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:38 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:39 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 0.854s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:39 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img Jul 06 10:14:39 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (caca0116-10e1-49aa-a092-eeb64c879739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fc1259-f972-460f-a02a-a477063466f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fc1259-f972-460f-a02a-a477063466f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1445976395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42882e32-c88f-4bee-993e-a80fd1b0046e,host='devstack@QuobyteHD#QuobyteHD',id=7b596293-8fd6-4e5a-b844-e9d5ab3702eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:14:39Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9850cd-30f5-4cf0-9175-e74e528a96b5),volume_type_id=3f9850cd-30f5-4cf0-9175-e74e528a96b5)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0f1bf4-58ed-44fc-bad5-8a68f2a1c63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0f1bf4-58ed-44fc-bad5-8a68f2a1c63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e327f0a9-9303-4c0d-aeae-a11858d636d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e327f0a9-9303-4c0d-aeae-a11858d636d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b596293-8fd6-4e5a-b844-e9d5ab3702eb', 'volume_name': 'volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71d3460-7ca8-4d05-93c4-065fe2850857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71d3460-7ca8-4d05-93c4-065fe2850857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0844b7-9a10-46df-a94e-53a0ceacd9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Volume 7b596293-8fd6-4e5a-b844-e9d5ab3702eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb', 'volume_size': 1} Jul 06 10:14:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:46 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img" returned: 0 in 6.797s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf11fc8-85c1-41ee-bddd-e874c55ae4f1]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:46 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:46 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-cbd4fb0b-dc35-4b01-9475-a67ebeccb865 req-86bb59d1-ca1a-4471-824c-d84230468e02 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Terminate volume connection completed successfully. Jul 06 10:14:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-cbd4fb0b-dc35-4b01-9475-a67ebeccb865 req-86bb59d1-ca1a-4471-824c-d84230468e02 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Deleting attachment 0d2dcffe-c228-493b-8286-f7c6457aa8c9. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:14:47 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 0.971s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:47 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:14:47 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Converted 1024.00 MB image at 150.64 MB/s Jul 06 10:14:47 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] 785f25b8-c26f-4eed-af35-0a50960af696 was raw, converting to qcow2 {{(pid=86456) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 10:14:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb43ab-e252-49b6-a42f-9c3a60e3e539]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:47 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img Jul 06 10:14:47 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:47 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img" returned: 0 in 0.703s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:47 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img Jul 06 10:14:47 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:48 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img" returned: 1 in 0.710s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img /opt/stack/data/cinder/conversion/vol_upload_ab0zkbds {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:48 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img /opt/stack/data/cinder/conversion/vol_upload_ab0zkbds Jul 06 10:14:48 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Acquiring lock "cinder-861969d5-38bb-416d-9cd2-77ccdfca1d9b-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "cinder-861969d5-38bb-416d-9cd2-77ccdfca1d9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Acquiring lock "cinder-quobyte-861969d5-38bb-416d-9cd2-77ccdfca1d9b" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "cinder-quobyte-861969d5-38bb-416d-9cd2-77ccdfca1d9b" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d63b6f-8906-4530-a19a-20e931ecfbf3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:48 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b Jul 06 10:14:48 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:49 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img /opt/stack/data/cinder/conversion/vol_upload_ab0zkbds" returned: 0 in 0.660s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:49 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Image conversion details: src /opt/stack/data/cinder/conversion/0595fb05-73cf-4341-98df-319f1cd32a01.temp_image.785f25b8-c26f-4eed-af35-0a50960af696onzamucz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ab0zkbds {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:14:49 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 06 10:14:49 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4157c3-1564-42fd-b51c-a1fd9eb4d682]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ab0zkbds {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:49 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ab0zkbds Jul 06 10:14:49 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:49 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b" returned: 0 in 0.771s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:49 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b Jul 06 10:14:49 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:49 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ab0zkbds" returned: 0 in 0.735s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:50 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-861969d5-38bb-416d-9cd2-77ccdfca1d9b" returned: 0 in 0.643s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "cinder-quobyte-861969d5-38bb-416d-9cd2-77ccdfca1d9b" released by "delete_volume" :: held 1.464s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Created reservations ['ecc1f215-3cd5-4aa9-8652-3a6f266f6ce7', '57cbc0c8-0dde-43eb-a00b-bdd944b0e356', '84336477-1205-4518-ae1e-c13fc1758ddf', '362393ee-8267-462c-ab9b-68a18aa92c6e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:50 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:14:50 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:50 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.658s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:14:50 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Deleted volume successfully. Jul 06 10:14:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1e273260-3bc9-47ff-8a19-706a957acb12 tempest-TestServerVolumeAttachScenarioOldVersion-2028215284 None] Lock "cinder-861969d5-38bb-416d-9cd2-77ccdfca1d9b-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.845s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Uploaded volume to glance image-id: 785f25b8-c26f-4eed-af35-0a50960af696. {{(pid=86456) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.829s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42882e32-c88f-4bee-993e-a80fd1b0046e,created_at=2026-07-06T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1445976395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42882e32-c88f-4bee-993e-a80fd1b0046e,host='devstack@QuobyteHD#QuobyteHD',id=7b596293-8fd6-4e5a-b844-e9d5ab3702eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:14:39Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9850cd-30f5-4cf0-9175-e74e528a96b5),volume_type_id=3f9850cd-30f5-4cf0-9175-e74e528a96b5)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Creating volume 7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:14:51 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:14:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:51 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb 1073741824 Jul 06 10:14:51 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cf96fca0-4be7-42a6-861a-062920b7ad13 tempest-VolumesActionsTest-88179739 None] Copy volume to image completed successfully. Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Acquiring lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Acquiring lock "cinder-quobyte-0595fb05-73cf-4341-98df-319f1cd32a01" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Lock "cinder-quobyte-0595fb05-73cf-4341-98df-319f1cd32a01" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e27f75-37a9-4325-9995-3310ea7674d9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:52 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb 1073741824" returned: 0 in 1.098s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:52 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:52 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:52 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb Jul 06 10:14:52 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:53 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" returned: 0 in 1.066s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0844b7-9a10-46df-a94e-53a0ceacd9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81748eb-ee87-46ef-a863-6b3eddf085e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:53 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Volume volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb (7b596293-8fd6-4e5a-b844-e9d5ab3702eb): created successfully Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81748eb-ee87-46ef-a863-6b3eddf085e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (caca0116-10e1-49aa-a092-eeb64c879739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:14:53 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1d4c9425-94a0-4c07-8b89-8b01a2a2dac8 tempest-GroupSnapshotsTest-1376314478 None] Created volume successfully. Jul 06 10:14:53 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 1.470s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:53 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01 Jul 06 10:14:53 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:54 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0595fb05-73cf-4341-98df-319f1cd32a01" returned: 0 in 0.918s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Lock "cinder-quobyte-0595fb05-73cf-4341-98df-319f1cd32a01" released by "delete_volume" :: held 2.453s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Created reservations ['91fa437a-800d-4e4a-a651-b60e341c1bb0', 'f41b0679-9f6b-4f83-aeeb-86cedc6eec62', 'c960fe3d-a165-44a6-a2fc-07b37d044b46', '2d701eec-b68c-470e-be2e-25487d930293'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:54 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:14:54 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d6b0a240-ea38-4fbe-bff3-7f6c5a0f5a38 tempest-GroupSnapshotsTest-1376314478 None] Update group completed successfully. Jul 06 10:14:55 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.661s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:55 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:14:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Deleted volume successfully. Jul 06 10:14:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1a6f047b-5554-448d-a715-d66257a70930 tempest-VolumesActionsTest-88179739 None] Lock "cinder-0595fb05-73cf-4341-98df-319f1cd32a01-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:14:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-05e60f12-c918-4940-a799-f13a973d9d26 tempest-GroupSnapshotsTest-1376314478 None] Update group completed successfully. Jul 06 10:14:57 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4b42f2aa-73bf-4e7c-925c-e1d1995b89c2 tempest-GroupSnapshotsTest-1376314478 None] Update group completed successfully. Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Flow 'volume_create_manager' (17fe4e69-651b-4d82-88b0-1f78ef1b3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c246c57-104e-4408-97a3-6681f9e325eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c246c57-104e-4408-97a3-6681f9e325eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-380762014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9b4af9-72a0-401c-8e73-b52b0f997d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6161575064f14ab7a89b08c60e741734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:14:58Z,use_quota=True,user_id='4034f20746d149a1aaeec47c3c098a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e494bc8-e2e4-405b-89c7-8cd456e3a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e494bc8-e2e4-405b-89c7-8cd456e3a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be298bd-8cc1-4429-b21c-5d8476d000ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be298bd-8cc1-4429-b21c-5d8476d000ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9b4af9-72a0-401c-8e73-b52b0f997d52', 'volume_name': 'volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae66a427-e567-41a9-a435-6de73507e42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae66a427-e567-41a9-a435-6de73507e42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd78d972-108d-4fad-8415-a67142931313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:14:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Volume 4f9b4af9-72a0-401c-8e73-b52b0f997d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52', 'volume_size': 1} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-380762014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9b4af9-72a0-401c-8e73-b52b0f997d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6161575064f14ab7a89b08c60e741734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:14:58Z,use_quota=True,user_id='4034f20746d149a1aaeec47c3c098a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Creating volume 4f9b4af9-72a0-401c-8e73-b52b0f997d52 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:14:58 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:58 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 1073741824 Jul 06 10:14:58 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-54f59b1e-1259-405c-805f-ce61d6cfcfef tempest-GroupSnapshotsTest-1376314478 None] Update group completed successfully. Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:14:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:58 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:14:58 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:59 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 1073741824" returned: 0 in 1.179s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:14:59 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 Jul 06 10:14:59 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:14:59 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 06 10:14:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.992s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:14:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:14:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:14:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:14:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:15:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] GroupSnapshot b7588292-5e3d-4b79-8056-35c78836ab1b: creating. Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Group snapshot b7588292-5e3d-4b79-8056-35c78836ab1b: creating. {{(pid=86456) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:00 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52" returned: 0 in 0.987s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.237s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Creating offline snapshot 4eb0d931-6635-45ed-b163-ebaaf6d46da7 of volume 7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd78d972-108d-4fad-8415-a67142931313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1a8bb6-49fe-4263-9b8e-c003c5adb4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e3d7bc-07a7-410b-8218-054eb880fa71]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:00 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Volume volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 (4f9b4af9-72a0-401c-8e73-b52b0f997d52): created successfully Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1a8bb6-49fe-4263-9b8e-c003c5adb4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Flow 'volume_create_manager' (17fe4e69-651b-4d82-88b0-1f78ef1b3655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a04e1c92-5aa3-445b-91bc-72a54b05d45f tempest-AttachVolumeTestJSON-1484649718 None] Created volume successfully. Jul 06 10:15:00 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb Jul 06 10:15:00 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:01 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" returned: 0 in 0.906s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:01 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 1G Jul 06 10:15:01 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:02 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 1G" returned: 0 in 1.011s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:02 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 Jul 06 10:15:02 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:03 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7" returned: 0 in 0.971s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:03 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:15:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:03 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 Jul 06 10:15:03 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:04 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7" returned: 0 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:04 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.info Jul 06 10:15:04 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-54a11d79-3746-4b7c-9098-092d472726d7 req-3e0a8a2d-11ce-4b4c-9152-74efdccace3e tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:05 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.info" returned: 0 in 0.717s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:05 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:15:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:05 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.info Jul 06 10:15:05 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:06 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.info" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.311s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Creating offline snapshot a1c27793-4b66-4a49-b5a4-0857d96727a6 of volume 6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:15:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b5ad3-8e3a-4301-9f28-287f54adf09f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:06 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 Jul 06 10:15:06 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:07 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5" returned: 0 in 1.007s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:07 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 1G Jul 06 10:15:07 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:08 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 1G" returned: 0 in 0.926s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:08 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 Jul 06 10:15:08 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:09 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6" returned: 0 in 1.123s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:09 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:15:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:09 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 Jul 06 10:15:09 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:09 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6" returned: 0 in 0.742s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:10 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.info Jul 06 10:15:10 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:10 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.info" returned: 0 in 0.845s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:10 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:15:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:10 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.info Jul 06 10:15:10 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:11 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.info" returned: 0 in 0.840s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.649s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-54a11d79-3746-4b7c-9098-092d472726d7 req-3e0a8a2d-11ce-4b4c-9152-74efdccace3e tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.829s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f337ad3d-b7e0-4b4e-821f-376ef5d8720b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-54a11d79-3746-4b7c-9098-092d472726d7 req-3e0a8a2d-11ce-4b4c-9152-74efdccace3e tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-64bcf4d8-b067-4df2-804e-fe63fdf70f5f tempest-GroupSnapshotsTest-1376314478 None] group_snapshot b7588292-5e3d-4b79-8056-35c78836ab1b: created successfully Jul 06 10:15:11 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 Jul 06 10:15:11 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] group_snapshot b7588292-5e3d-4b79-8056-35c78836ab1b: deleting Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] group_snapshot b7588292-5e3d-4b79-8056-35c78836ab1b: deleting {{(pid=86456) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-4eb0d931-6635-45ed-b163-ebaaf6d46da7" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-4eb0d931-6635-45ed-b163-ebaaf6d46da7" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Deleting offline snapshot 4eb0d931-6635-45ed-b163-ebaaf6d46da7 of volume 7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] snapshot_file for this snap is: volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0df96ce-ec1b-4a46-9004-f6ae45a8d43e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:13 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 Jul 06 10:15:13 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:13 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-54a11d79-3746-4b7c-9098-092d472726d7 req-3e0a8a2d-11ce-4b4c-9152-74efdccace3e tempest-AttachVolumeTestJSON-1484649718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52" returned: 0 in 1.401s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-54a11d79-3746-4b7c-9098-092d472726d7 req-3e0a8a2d-11ce-4b4c-9152-74efdccace3e tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.443s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-54a11d79-3746-4b7c-9098-092d472726d7 req-3e0a8a2d-11ce-4b4c-9152-74efdccace3e tempest-AttachVolumeTestJSON-1484649718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f33ebca5-81c1-43ea-85d0-597433e64110', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:15:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-54a11d79-3746-4b7c-9098-092d472726d7 req-3e0a8a2d-11ce-4b4c-9152-74efdccace3e tempest-AttachVolumeTestJSON-1484649718 None] attachment_update completed successfully. Jul 06 10:15:13 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7" returned: 0 in 1.117s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:15:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b9142b-ad85-46e7-89bc-de7beb71a581]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:14 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb Jul 06 10:15:14 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:15 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" returned: 0 in 1.145s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:15 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 Jul 06 10:15:15 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:16 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7" returned: 0 in 1.165s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:16 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7 Jul 06 10:15:16 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:17 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb.4eb0d931-6635-45ed-b163-ebaaf6d46da7" returned: 0 in 0.727s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-4eb0d931-6635-45ed-b163-ebaaf6d46da7" released by "_delete_snapshot" :: held 4.327s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" released by "delete_snapshot" :: held 4.375s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-6074c4dd-c9d1-46be-989d-6119433c5cf5" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6074c4dd-c9d1-46be-989d-6119433c5cf5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-a1c27793-4b66-4a49-b5a4-0857d96727a6" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-a1c27793-4b66-4a49-b5a4-0857d96727a6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Deleting offline snapshot a1c27793-4b66-4a49-b5a4-0857d96727a6 of volume 6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] snapshot_file for this snap is: volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d599cd89-55cd-4fb0-91f4-ca34c6ce4b25]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:17 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 Jul 06 10:15:17 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Flow 'volume_create_manager' (38ebb3b6-7411-42d9-b56d-d040e596f2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b580209-71a5-49b6-8dce-5fed50f59f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b580209-71a5-49b6-8dce-5fed50f59f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6219173-8098-44c3-8030-46e09e2681ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce8a037e5814589a8e868c3720609c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:17Z,use_quota=True,user_id='53e83832460645028d98813e6096a7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003f943-af03-44e5-9e6d-cc43ebcc7657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003f943-af03-44e5-9e6d-cc43ebcc7657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfd44bf-6766-4094-b457-a2c4ae1df542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfd44bf-6766-4094-b457-a2c4ae1df542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6219173-8098-44c3-8030-46e09e2681ba', 'volume_name': 'volume-b6219173-8098-44c3-8030-46e09e2681ba', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b80e5e0-27de-40d7-aeae-feddcf0dafde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b80e5e0-27de-40d7-aeae-feddcf0dafde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c658c419-5e6d-489d-8627-644ba8b08b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:17 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Volume b6219173-8098-44c3-8030-46e09e2681ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6219173-8098-44c3-8030-46e09e2681ba', 'volume_size': 1} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6219173-8098-44c3-8030-46e09e2681ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce8a037e5814589a8e868c3720609c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:17Z,use_quota=True,user_id='53e83832460645028d98813e6096a7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Creating volume b6219173-8098-44c3-8030-46e09e2681ba {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:15:17 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:15:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:17 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba 1073741824 Jul 06 10:15:17 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:18 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6" returned: 0 in 1.191s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6074c4dd-c9d1-46be-989d-6119433c5cf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9f8b38-e0ed-4ddf-8b21-9bf52a13d887]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Flow 'volume_create_manager' (8de0e4ea-1d5a-41d1-ae66-9bc0e3fd04ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ded07bf-303c-41cb-b58e-2f0231ee0f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ded07bf-303c-41cb-b58e-2f0231ee0f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1856847733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bad5e3-6178-4230-aa7c-d33ff7e7c113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6161575064f14ab7a89b08c60e741734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:18Z,use_quota=True,user_id='4034f20746d149a1aaeec47c3c098a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9480b3-1169-44b8-8b84-44c8ea8a080a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9480b3-1169-44b8-8b84-44c8ea8a080a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f49ffd-b4dc-46ee-b2c5-f84a4df8b265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f49ffd-b4dc-46ee-b2c5-f84a4df8b265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bad5e3-6178-4230-aa7c-d33ff7e7c113', 'volume_name': 'volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:18 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 Jul 06 10:15:18 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57477838-00ac-4134-a8cb-d521c5a80149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57477838-00ac-4134-a8cb-d521c5a80149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f678d32b-2b97-4923-81dc-0491db108582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:18 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Volume c0bad5e3-6178-4230-aa7c-d33ff7e7c113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113', 'volume_size': 1} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:18 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba 1073741824" returned: 0 in 1.075s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:18 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba Jul 06 10:15:18 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:19 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5" returned: 0 in 0.917s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:19 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 Jul 06 10:15:19 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:19 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba" returned: 0 in 0.845s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.980s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1856847733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bad5e3-6178-4230-aa7c-d33ff7e7c113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6161575064f14ab7a89b08c60e741734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:18Z,use_quota=True,user_id='4034f20746d149a1aaeec47c3c098a01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Creating volume c0bad5e3-6178-4230-aa7c-d33ff7e7c113 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:15:19 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:19 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 1073741824 Jul 06 10:15:19 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c658c419-5e6d-489d-8627-644ba8b08b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6219173-8098-44c3-8030-46e09e2681ba', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090878e7-cc33-4e03-b359-0ac555886931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:19 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Volume volume-b6219173-8098-44c3-8030-46e09e2681ba (b6219173-8098-44c3-8030-46e09e2681ba): created successfully Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090878e7-cc33-4e03-b359-0ac555886931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Flow 'volume_create_manager' (38ebb3b6-7411-42d9-b56d-d040e596f2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:19 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-832bb606-c711-4395-933a-787ba7ff1110 tempest-CinderUnicodeTest-940212352 None] Created volume successfully. Jul 06 10:15:20 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6" returned: 0 in 0.945s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:20 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6 Jul 06 10:15:20 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:20 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 1073741824" returned: 0 in 1.093s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:20 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 Jul 06 10:15:20 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:21 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5.a1c27793-4b66-4a49-b5a4-0857d96727a6" returned: 0 in 1.071s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-a1c27793-4b66-4a49-b5a4-0857d96727a6" released by "_delete_snapshot" :: held 4.329s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6074c4dd-c9d1-46be-989d-6119433c5cf5" released by "delete_snapshot" :: held 4.373s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:21 devstack cinder-volume[86456]: WARNING cinder.quota [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-346369993 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-346369993, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:15:21 devstack cinder-volume[86456]: WARNING cinder.quota [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-346369993 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-346369993, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['ed33e17e-ea73-4eea-b92b-ed3b98c96e38', 'c45322c0-74d0-48c6-98eb-a8e1ecf92029', '2ed1efa7-312c-47f5-9840-15340c33a8a3', '6603ba28-bfdf-41e5-b56b-2b459cf4e37c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Flow 'volume_create_manager' (b9e58738-a9e9-4693-8bde-c880b2c0876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c34db88-9a1d-4997-8a4f-b1114709bccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c34db88-9a1d-4997-8a4f-b1114709bccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-184204186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e570a60-01a8-4f61-a121-318bfd504a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce8a037e5814589a8e868c3720609c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:22Z,use_quota=True,user_id='53e83832460645028d98813e6096a7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd834c5-a48a-4ac6-8337-e02c36edece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd834c5-a48a-4ac6-8337-e02c36edece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:21 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9568cec-4f59-40b3-a17e-3a1d93cbba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9568cec-4f59-40b3-a17e-3a1d93cbba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e570a60-01a8-4f61-a121-318bfd504a88', 'volume_name': 'volume-3e570a60-01a8-4f61-a121-318bfd504a88', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fd61b1-bfd6-4eaa-9cb3-c7e947910d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fd61b1-bfd6-4eaa-9cb3-c7e947910d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e472f2-7f17-47fb-9c17-ba59b4b8d90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Volume 3e570a60-01a8-4f61-a121-318bfd504a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e570a60-01a8-4f61-a121-318bfd504a88', 'volume_size': 1} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113" returned: 0 in 0.982s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-184204186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e570a60-01a8-4f61-a121-318bfd504a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce8a037e5814589a8e868c3720609c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:22Z,use_quota=True,user_id='53e83832460645028d98813e6096a7ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Creating volume 3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:15:21 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:21 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 1073741824 Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f678d32b-2b97-4923-81dc-0491db108582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:21 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61d6aab-88b5-49b3-a7b2-47e47853ea5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Volume volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 (c0bad5e3-6178-4230-aa7c-d33ff7e7c113): created successfully Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61d6aab-88b5-49b3-a7b2-47e47853ea5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Flow 'volume_create_manager' (8de0e4ea-1d5a-41d1-ae66-9bc0e3fd04ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5643130a-97ef-469d-88da-cb1177085556 tempest-AttachVolumeTestJSON-1484649718 None] Created volume successfully. Jul 06 10:15:22 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['92f94417-e637-4879-935e-03c5a2519678', 'ebe4af06-f9e2-4ce6-9697-238393f45c63', '39b89cd6-240b-46b4-beb5-f52e9329ab95', '60777267-8509-4c07-9ab4-417cbedded29'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1c7f7896-f3f2-4f77-a887-460ebc167ca0 tempest-GroupSnapshotsTest-1376314478 None] group_snapshot b7588292-5e3d-4b79-8056-35c78836ab1b: deleted successfully Jul 06 10:15:22 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 1073741824" returned: 0 in 0.966s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:22 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 Jul 06 10:15:22 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-6074c4dd-c9d1-46be-989d-6119433c5cf5" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6074c4dd-c9d1-46be-989d-6119433c5cf5" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59aeeb4-08a3-4cab-9233-fc4c7a0e6a27]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:23 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88" returned: 0 in 0.767s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:23 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 Jul 06 10:15:23 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e472f2-7f17-47fb-9c17-ba59b4b8d90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e570a60-01a8-4f61-a121-318bfd504a88', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437d254a-1504-4a23-91ac-2c5f27fd2d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Volume volume-3e570a60-01a8-4f61-a121-318bfd504a88 (3e570a60-01a8-4f61-a121-318bfd504a88): created successfully Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437d254a-1504-4a23-91ac-2c5f27fd2d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Flow 'volume_create_manager' (b9e58738-a9e9-4693-8bde-c880b2c0876b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3f58deac-a7a0-4832-9e64-d7f0826f41ec tempest-CinderUnicodeTest-940212352 None] Created volume successfully. Jul 06 10:15:24 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5" returned: 0 in 0.926s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:24 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5 Jul 06 10:15:24 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Creating offline snapshot e9ac556c-39fa-449a-ac30-aadd715383f8 of volume 3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c579db4-f607-497f-ba93-8dcd71848496]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:25 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6074c4dd-c9d1-46be-989d-6119433c5cf5" returned: 0 in 0.805s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-6074c4dd-c9d1-46be-989d-6119433c5cf5" released by "delete_volume" :: held 1.827s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:25 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 Jul 06 10:15:25 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2d54a1-66dc-42b9-9f20-aad3ea569b78]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:25 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb Jul 06 10:15:25 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:26 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88" returned: 0 in 0.951s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:26 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 1G Jul 06 10:15:26 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:26 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" returned: 0 in 1.004s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:26 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb Jul 06 10:15:26 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-1ff3c80c-c4f4-4b27-8b55-646031e602f8 req-d6abdd68-aa6e-4081-ba98-b59610bdbe39 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:26 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 1G" returned: 0 in 0.944s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e570a60-01a8-4f61-a121-318bfd504a88 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:27 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e570a60-01a8-4f61-a121-318bfd504a88 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 Jul 06 10:15:27 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:27 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" returned: 0 in 0.779s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-7b596293-8fd6-4e5a-b844-e9d5ab3702eb" released by "delete_volume" :: held 1.868s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['d95e869a-674c-4415-ae8d-8c01b8461a71'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:27 devstack cinder-volume[86456]: WARNING cinder.quota [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-346369993 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-346369993, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['4bf98ea8-d5d0-404e-bc7d-143c7c9d3a22', 'b8d5d0fa-4cb6-4f97-bde1-2152b0dd1dc5', '119493f4-4f6e-4dd7-9b46-a1d10a8a8326', '706427c3-a5a2-44b8-837e-5392e78569f5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['9eeffe11-328c-44e9-987a-808cd3c0e1a2', 'ee7d6741-8473-4a8d-85d1-fa4a4bbf78c1', '192f75b6-92ea-4913-b64d-cce11421dc6e', 'e2099717-c740-4902-9ded-391989048218'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:27 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:15:27 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:27 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e570a60-01a8-4f61-a121-318bfd504a88 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8" returned: 0 in 0.838s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:27 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 is being set with open permissions: ugo+rw Jul 06 10:15:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:27 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 Jul 06 10:15:27 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:28 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.820s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:28 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:15:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c6f36137-8db0-4aeb-8b40-17ff92cf5be2 tempest-GroupSnapshotsTest-1376314478 None] Delete group completed successfully. Jul 06 10:15:28 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8" returned: 0 in 0.804s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:28 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=75,cinder:UPDATE=77,cinder:INSERT=15,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:15:28 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=76,cinder:SELECT=82,cinder:DELETE=6,cinder:INSERT=18 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:15:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f9b9a808-627f-4597-82fe-79e2ac4f88ce tempest-GroupSnapshotsTest-1376314478 None] Group tempest-GroupSnapshotsTest-Group-2009523973: creating Jul 06 10:15:28 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.info Jul 06 10:15:28 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f9b9a808-627f-4597-82fe-79e2ac4f88ce tempest-GroupSnapshotsTest-1376314478 None] Group tempest-GroupSnapshotsTest-Group-2009523973: created successfully Jul 06 10:15:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f9b9a808-627f-4597-82fe-79e2ac4f88ce tempest-GroupSnapshotsTest-1376314478 None] Create group completed successfully. Jul 06 10:15:29 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.info" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:29 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.info is being set with open permissions: ugo+rw Jul 06 10:15:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:29 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.info Jul 06 10:15:29 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:30 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.info" returned: 0 in 0.720s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.165s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-1ff3c80c-c4f4-4b27-8b55-646031e602f8 req-d6abdd68-aa6e-4081-ba98-b59610bdbe39 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.817s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b7833-d2f1-4bd6-9500-80531f42dcee]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-1ff3c80c-c4f4-4b27-8b55-646031e602f8 req-d6abdd68-aa6e-4081-ba98-b59610bdbe39 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f11b0478-9441-4a9b-b05d-df0bdfab5efd tempest-CinderUnicodeTest-940212352 None] Create snapshot completed successfully Jul 06 10:15:30 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 Jul 06 10:15:30 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (c05f104d-59cb-4351-8ed0-50b6e7efa809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9538408c-0bb7-4dad-a2e2-df1f5a0373e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9538408c-0bb7-4dad-a2e2-df1f5a0373e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1151826285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08be8784-2035-48dc-a948-0e7470d91316,host='devstack@QuobyteHD#QuobyteHD',id=63fbad55-d90f-4408-a91b-c7fc4d1bdce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:30Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5743eb67-ae6b-4095-a1de-3b4623a92c61),volume_type_id=5743eb67-ae6b-4095-a1de-3b4623a92c61)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0fb2bf-11f4-4062-8d56-3c4dc31c1ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0fb2bf-11f4-4062-8d56-3c4dc31c1ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d3bb7a-cd17-4d36-ba97-b630f025e033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d3bb7a-cd17-4d36-ba97-b630f025e033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fbad55-d90f-4408-a91b-c7fc4d1bdce6', 'volume_name': 'volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d0b440-98b3-40a7-85d7-453cd2f80095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d0b440-98b3-40a7-85d7-453cd2f80095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded78c5a-12b0-4eda-a4f1-23be04a17ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:30 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Volume 63fbad55-d90f-4408-a91b-c7fc4d1bdce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6', 'volume_size': 1} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Acquiring lock "cinder-e9ac556c-39fa-449a-ac30-aadd715383f8-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Lock "cinder-e9ac556c-39fa-449a-ac30-aadd715383f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Acquiring lock "cinder-quobyte-3e570a60-01a8-4f61-a121-318bfd504a88" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-3e570a60-01a8-4f61-a121-318bfd504a88" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Acquiring lock "cinder-quobyte-e9ac556c-39fa-449a-ac30-aadd715383f8" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-e9ac556c-39fa-449a-ac30-aadd715383f8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Deleting offline snapshot e9ac556c-39fa-449a-ac30-aadd715383f8 of volume 3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] snapshot_file for this snap is: volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0f8af5-446a-48a7-9e8e-22f40d29f6bc]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:30 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 Jul 06 10:15:30 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:31 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-1ff3c80c-c4f4-4b27-8b55-646031e602f8 req-d6abdd68-aa6e-4081-ba98-b59610bdbe39 tempest-AttachVolumeTestJSON-1484649718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113" returned: 0 in 0.928s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-1ff3c80c-c4f4-4b27-8b55-646031e602f8 req-d6abdd68-aa6e-4081-ba98-b59610bdbe39 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=08be8784-2035-48dc-a948-0e7470d91316,created_at=2026-07-06T08:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1151826285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=08be8784-2035-48dc-a948-0e7470d91316,host='devstack@QuobyteHD#QuobyteHD',id=63fbad55-d90f-4408-a91b-c7fc4d1bdce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28642ad07bab4519aa32606b5dc8c89a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:30Z,use_quota=True,user_id='748199042dbd4f599c70952959642ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5743eb67-ae6b-4095-a1de-3b4623a92c61),volume_type_id=5743eb67-ae6b-4095-a1de-3b4623a92c61)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Creating volume 63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:15:31 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:31 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 1073741824 Jul 06 10:15:31 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-1ff3c80c-c4f4-4b27-8b55-646031e602f8 req-d6abdd68-aa6e-4081-ba98-b59610bdbe39 tempest-AttachVolumeTestJSON-1484649718 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c551654f-7886-45ea-9d35-f72bece8d241', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:15:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-1ff3c80c-c4f4-4b27-8b55-646031e602f8 req-d6abdd68-aa6e-4081-ba98-b59610bdbe39 tempest-AttachVolumeTestJSON-1484649718 None] attachment_update completed successfully. Jul 06 10:15:31 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8" returned: 0 in 1.014s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e570a60-01a8-4f61-a121-318bfd504a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[397a8a91-0800-48ca-96b7-64b3e2f0c8e2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:31 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 Jul 06 10:15:31 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:32 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 1073741824" returned: 0 in 1.081s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:32 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 Jul 06 10:15:32 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:32 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88" returned: 0 in 1.022s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:32 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 Jul 06 10:15:32 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:33 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" returned: 0 in 0.829s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded78c5a-12b0-4eda-a4f1-23be04a17ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7919713-2657-422c-969e-e0f534201495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Volume volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 (63fbad55-d90f-4408-a91b-c7fc4d1bdce6): created successfully Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7919713-2657-422c-969e-e0f534201495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Flow 'volume_create_manager' (c05f104d-59cb-4351-8ed0-50b6e7efa809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:33 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-088fe9cf-c8d1-4cc5-a3df-e6da81e4ee69 tempest-GroupSnapshotsTest-1376314478 None] Created volume successfully. Jul 06 10:15:33 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8" returned: 0 in 0.816s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:33 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8 Jul 06 10:15:33 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:34 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88.e9ac556c-39fa-449a-ac30-aadd715383f8" returned: 0 in 0.653s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] GroupSnapshot 3def0807-51bb-4c5a-888a-74d0ea8ec42a: creating. Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-e9ac556c-39fa-449a-ac30-aadd715383f8" released by "_delete_snapshot" :: held 3.668s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Group snapshot 3def0807-51bb-4c5a-888a-74d0ea8ec42a: creating. {{(pid=86456) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-3e570a60-01a8-4f61-a121-318bfd504a88" released by "delete_snapshot" :: held 3.701s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Creating offline snapshot a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 of volume 63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b39e1-6c09-4a1e-b45c-70f5c5c58d28]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Created reservations ['adc156d2-17bc-4d63-8787-cc670a443685', '5ff1b10b-a36f-48ac-971c-38e24818472f', '05b8f59d-69c1-4578-adcc-d088f14112bc', '06eae7d1-298d-4f54-bfa1-210857dc705e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Delete snapshot completed successfully. Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-004b9db3-433f-4a08-bc8b-7d96979b3dcd tempest-CinderUnicodeTest-940212352 None] Lock "cinder-e9ac556c-39fa-449a-ac30-aadd715383f8-delete_snapshot" released by "delete_snapshot" :: held 3.890s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:34 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 Jul 06 10:15:34 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Acquiring lock "cinder-3e570a60-01a8-4f61-a121-318bfd504a88-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Lock "cinder-3e570a60-01a8-4f61-a121-318bfd504a88-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Acquiring lock "cinder-quobyte-3e570a60-01a8-4f61-a121-318bfd504a88" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-3e570a60-01a8-4f61-a121-318bfd504a88" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[423661d4-6f76-4083-983c-99c137933f74]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:35 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 Jul 06 10:15:35 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:35 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" returned: 0 in 0.784s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:35 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 1G Jul 06 10:15:35 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:35 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88" returned: 0 in 0.811s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:35 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88 Jul 06 10:15:35 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:36 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 1G" returned: 0 in 0.962s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:36 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 Jul 06 10:15:36 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:36 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3e570a60-01a8-4f61-a121-318bfd504a88" returned: 0 in 0.663s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-3e570a60-01a8-4f61-a121-318bfd504a88" released by "delete_volume" :: held 1.536s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Created reservations ['effd1498-a9e6-40a9-ba42-f9e5bcd2cf16', '4cc8d6e3-3d72-46ed-9f94-9710fc2092d6', '825ed801-c3a1-4708-a2e3-54fa6158fcbd', 'cc37ec6a-a963-4c20-951d-8af59f234d00'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:36 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:15:36 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:36 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" returned: 0 in 0.762s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:36 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:15:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:37 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 Jul 06 10:15:37 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Acquiring lock "cinder-b6219173-8098-44c3-8030-46e09e2681ba-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Lock "cinder-b6219173-8098-44c3-8030-46e09e2681ba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Acquiring lock "cinder-quobyte-b6219173-8098-44c3-8030-46e09e2681ba" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-b6219173-8098-44c3-8030-46e09e2681ba" acquired by "delete_volume" :: waited 0.030s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:37 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a3d84-f72c-4002-a881-a6b78636642f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Deleted volume successfully. Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15837bac-60de-430a-b6db-944b16328faa tempest-CinderUnicodeTest-940212352 None] Lock "cinder-3e570a60-01a8-4f61-a121-318bfd504a88-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:37 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba Jul 06 10:15:37 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-4b3c1bad-f763-40c2-87c0-b2f3944cd2a4 req-11dd315c-a5be-4a87-8927-04a704a772b4 tempest-AttachVolumeTestJSON-1484649718 None] Terminate volume connection completed successfully. Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-4b3c1bad-f763-40c2-87c0-b2f3944cd2a4 req-11dd315c-a5be-4a87-8927-04a704a772b4 tempest-AttachVolumeTestJSON-1484649718 None] Deleting attachment f33ebca5-81c1-43ea-85d0-597433e64110. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:15:37 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" returned: 0 in 0.881s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:37 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.info Jul 06 10:15:37 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:38 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba" returned: 0 in 1.170s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:38 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba Jul 06 10:15:38 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:38 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.info" returned: 0 in 1.049s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:38 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:15:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:39 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.info Jul 06 10:15:39 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:39 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b6219173-8098-44c3-8030-46e09e2681ba" returned: 0 in 1.127s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Lock "cinder-quobyte-b6219173-8098-44c3-8030-46e09e2681ba" released by "delete_volume" :: held 2.378s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Created reservations ['d6550804-2230-4794-93a2-4cfba1c57a1c', '660ad906-11c6-4453-95d3-1f1f7c44ca1b', 'a27adb75-fa20-4a82-babc-13bbc2fd03e0', '219a54fb-d9f2-467d-8d51-2a0655f07283'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:39 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:15:39 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:39 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.info" returned: 0 in 1.035s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.576s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d683d3ed-77a1-4d1e-8017-f509d82a2b67 tempest-GroupSnapshotsTest-1376314478 None] group_snapshot 3def0807-51bb-4c5a-888a-74d0ea8ec42a: created successfully Jul 06 10:15:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-c9130be1-d05f-4f8c-a26a-7978aa9a8814 req-652ba7d5-b041-45ea-8790-1f1cf76d9dcb tempest-AttachVolumeTestJSON-1484649718 None] Terminate volume connection completed successfully. Jul 06 10:15:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-c9130be1-d05f-4f8c-a26a-7978aa9a8814 req-652ba7d5-b041-45ea-8790-1f1cf76d9dcb tempest-AttachVolumeTestJSON-1484649718 None] Deleting attachment c551654f-7886-45ea-9d35-f72bece8d241. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:15:40 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.932s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:40 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:15:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Deleted volume successfully. Jul 06 10:15:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3d75f5ee-1b84-4c8a-ba63-da1c263d50e1 tempest-CinderUnicodeTest-940212352 None] Lock "cinder-b6219173-8098-44c3-8030-46e09e2681ba-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] group_snapshot 3def0807-51bb-4c5a-888a-74d0ea8ec42a: deleting Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] group_snapshot 3def0807-51bb-4c5a-888a-74d0ea8ec42a: deleting {{(pid=86456) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Deleting offline snapshot a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 of volume 63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] snapshot_file for this snap is: volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8244d020-29cc-4725-8425-0db21e530d94]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:41 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 Jul 06 10:15:41 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:42 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" returned: 0 in 0.914s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:15:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[965416cb-f72f-4083-bc14-3524506e8f1e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:42 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 Jul 06 10:15:42 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:43 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" returned: 0 in 1.051s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:43 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 Jul 06 10:15:43 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:44 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" returned: 0 in 1.108s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:44 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5 Jul 06 10:15:44 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:45 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6.a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" returned: 0 in 1.078s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-a43f6a51-e88e-4bc6-8290-5dbb8041e8e5" released by "_delete_snapshot" :: held 4.291s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" released by "delete_snapshot" :: held 4.317s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:45 devstack cinder-volume[86456]: WARNING cinder.quota [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2057656162 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2057656162, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:15:45 devstack cinder-volume[86456]: WARNING cinder.quota [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2057656162 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2057656162, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:15:45 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['8e1b8d50-c9cb-42c8-aa13-e4d8ed46d646', '89a8e440-9c87-43d2-9e5e-d8a544bceaed', '68c49be5-70d8-402f-90a4-556b1c340eeb', '29be2679-7fdd-48f2-8967-ef8eef786329'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-756fa2f1-cc31-4275-990f-467875d2a7fa tempest-GroupSnapshotsTest-1376314478 None] group_snapshot 3def0807-51bb-4c5a-888a-74d0ea8ec42a: deleted successfully Jul 06 10:15:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "cinder-quobyte-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0023732-02e1-4df6-8259-e24077a6c449]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:47 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 Jul 06 10:15:47 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:48 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" returned: 0 in 1.124s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:48 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6 Jul 06 10:15:48 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:49 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" returned: 0 in 0.892s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Lock "cinder-quobyte-63fbad55-d90f-4408-a91b-c7fc4d1bdce6" released by "delete_volume" :: held 2.097s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['8480265f-3955-40c8-9131-e1a4c1e68015'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:49 devstack cinder-volume[86456]: WARNING cinder.quota [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2057656162 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2057656162, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Created reservations ['a9294384-278a-4656-b9fe-5d6f72e93dad', '44a0c7ae-ac54-46e6-9a21-a3a76dfc88cf', '48a45b0f-91bb-47f7-b690-6db55d075060', '768fdaff-69a5-46d4-8aec-dda712c8ef49'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:49 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:15:49 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:51 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Flow 'volume_create_manager' (c413839b-ebd1-4d93-ba6a-4af98562f875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57d8944-e149-4298-b9c6-5aa34f14634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.617s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:15:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-96f1a5e2-4826-4622-a03a-90161a37f9d0 tempest-GroupSnapshotsTest-1376314478 None] Delete group completed successfully. Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57d8944-e149-4298-b9c6-5aa34f14634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-347606320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c83de3c-558b-4db2-91bb-8ed9f9106008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e1e5771d3f4ec2b578267a64e52bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:51Z,use_quota=True,user_id='0684a20785b84c708f495eb733a45f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3045264-3b31-412d-8393-d4345a715172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3045264-3b31-412d-8393-d4345a715172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c368d7d9-7d97-4f25-94d7-fcd363ed46ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c368d7d9-7d97-4f25-94d7-fcd363ed46ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c83de3c-558b-4db2-91bb-8ed9f9106008', 'volume_name': 'volume-8c83de3c-558b-4db2-91bb-8ed9f9106008', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5be103-501a-47e4-847d-60b63b589f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5be103-501a-47e4-847d-60b63b589f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92aa420-8dee-4b04-b8ec-5427e409411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:51 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Volume 8c83de3c-558b-4db2-91bb-8ed9f9106008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c83de3c-558b-4db2-91bb-8ed9f9106008', 'volume_size': 1} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-347606320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c83de3c-558b-4db2-91bb-8ed9f9106008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e1e5771d3f4ec2b578267a64e52bdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:15:51Z,use_quota=True,user_id='0684a20785b84c708f495eb733a45f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Creating volume 8c83de3c-558b-4db2-91bb-8ed9f9106008 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:15:51 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:15:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:51 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 1073741824 Jul 06 10:15:51 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:52 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 1073741824" returned: 0 in 1.155s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:52 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 Jul 06 10:15:52 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:53 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008" returned: 0 in 0.879s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:15:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92aa420-8dee-4b04-b8ec-5427e409411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c83de3c-558b-4db2-91bb-8ed9f9106008', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babbeeca-6f22-4fe3-858c-2df7a183a295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:15:53 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Volume volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 (8c83de3c-558b-4db2-91bb-8ed9f9106008): created successfully Jul 06 10:15:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babbeeca-6f22-4fe3-858c-2df7a183a295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:15:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Flow 'volume_create_manager' (c413839b-ebd1-4d93-ba6a-4af98562f875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:15:53 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-680042f7-27d6-4569-a813-6452d5e54b07 tempest-TestMinimumBasicScenario-1846108167 None] Created volume successfully. Jul 06 10:15:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "cinder-c0bad5e3-6178-4230-aa7c-d33ff7e7c113-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-c0bad5e3-6178-4230-aa7c-d33ff7e7c113-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "cinder-quobyte-c0bad5e3-6178-4230-aa7c-d33ff7e7c113" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-quobyte-c0bad5e3-6178-4230-aa7c-d33ff7e7c113" acquired by "delete_volume" :: waited 0.058s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbf2e99-d26f-4cbe-8b5d-641e7bff88ff]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:55 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 Jul 06 10:15:55 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:57 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113" returned: 0 in 1.621s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:57 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113 Jul 06 10:15:57 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:58 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c0bad5e3-6178-4230-aa7c-d33ff7e7c113" returned: 0 in 1.283s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-quobyte-c0bad5e3-6178-4230-aa7c-d33ff7e7c113" released by "delete_volume" :: held 2.990s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Created reservations ['05eba674-26b3-4803-abaf-fc23848ab96f', '82fbc4d5-3742-4915-acbb-e13267b7323e', 'bb53fc4e-8749-4df4-95d7-eacca7243924', 'b327da7c-7a91-4b28-bf00-5fbde90f4e35'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-4d6188b5-b1f2-4aba-ae1b-35932eab4756 req-3f661eca-c2a6-4719-8578-eeaafe75c642 tempest-TestMinimumBasicScenario-1846108167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-4d6188b5-b1f2-4aba-ae1b-35932eab4756 req-3f661eca-c2a6-4719-8578-eeaafe75c642 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:58 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:15:58 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[791f62ab-de3c-4a50-960c-439cb6dcff56]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-4d6188b5-b1f2-4aba-ae1b-35932eab4756 req-3f661eca-c2a6-4719-8578-eeaafe75c642 tempest-TestMinimumBasicScenario-1846108167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:15:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:15:59 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:15:59 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:59 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 Jul 06 10:15:59 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:15:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "cinder-4f9b4af9-72a0-401c-8e73-b52b0f997d52-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-4f9b4af9-72a0-401c-8e73-b52b0f997d52-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:15:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "cinder-quobyte-4f9b4af9-72a0-401c-8e73-b52b0f997d52" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:15:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-quobyte-4f9b4af9-72a0-401c-8e73-b52b0f997d52" acquired by "delete_volume" :: waited 0.034s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ace1ab-0146-4897-806a-14154483ac33]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:00 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.371s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Deleted volume successfully. Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fc30d2da-f397-4795-a7b7-1e35c325e414 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-c0bad5e3-6178-4230-aa7c-d33ff7e7c113-delete_volume" released by "delete_volume" :: held 5.076s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:00 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 Jul 06 10:16:00 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:00 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.591s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:16:00 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-4d6188b5-b1f2-4aba-ae1b-35932eab4756 req-3f661eca-c2a6-4719-8578-eeaafe75c642 tempest-TestMinimumBasicScenario-1846108167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008" returned: 0 in 1.823s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-4d6188b5-b1f2-4aba-ae1b-35932eab4756 req-3f661eca-c2a6-4719-8578-eeaafe75c642 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.873s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-4d6188b5-b1f2-4aba-ae1b-35932eab4756 req-3f661eca-c2a6-4719-8578-eeaafe75c642 tempest-TestMinimumBasicScenario-1846108167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-8c83de3c-558b-4db2-91bb-8ed9f9106008', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1295bfb4-4d3f-4058-917f-c305ec2bb0aa', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:16:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-4d6188b5-b1f2-4aba-ae1b-35932eab4756 req-3f661eca-c2a6-4719-8578-eeaafe75c642 tempest-TestMinimumBasicScenario-1846108167 None] attachment_update completed successfully. Jul 06 10:16:01 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52" returned: 0 in 1.175s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:01 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52 Jul 06 10:16:01 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2e870cd8-1614-43b2-8fa0-60a04f990222 tempest-GroupSnapshotsV319Test-1275461289 None] Group tempest-GroupSnapshotsV319Test-Group-231789455: creating Jul 06 10:16:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2e870cd8-1614-43b2-8fa0-60a04f990222 tempest-GroupSnapshotsV319Test-1275461289 None] Group tempest-GroupSnapshotsV319Test-Group-231789455: created successfully Jul 06 10:16:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2e870cd8-1614-43b2-8fa0-60a04f990222 tempest-GroupSnapshotsV319Test-1275461289 None] Create group completed successfully. Jul 06 10:16:02 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9b4af9-72a0-401c-8e73-b52b0f997d52" returned: 0 in 0.840s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-quobyte-4f9b4af9-72a0-401c-8e73-b52b0f997d52" released by "delete_volume" :: held 2.132s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Created reservations ['575e5c29-af46-42f7-a573-91d908468d6a', 'd8727d89-561f-483b-9e77-ef9a7e031ddf', '53bf7943-0872-49bd-9142-a84f95fe5da4', 'f8b167a3-d7f0-48f2-9616-23ff34c917bf'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:02 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:16:02 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "cinder-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "cinder-quobyte-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-quobyte-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b582f26-f3ed-427b-93f6-5d5cabb710c5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:02 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd Jul 06 10:16:02 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Flow 'volume_create_manager' (605ea90a-8cbf-4e15-8664-8c91cc86069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a4ff50-8c10-4386-9dbc-d4a8f9ce4eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a4ff50-8c10-4386-9dbc-d4a8f9ce4eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-221704611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=201152cf-5a3c-4a7e-8b4a-1f4bd9d5d5d3,host='devstack@QuobyteHD#QuobyteHD',id=d0ccbcd1-233c-42b0-a1c1-f749c4a4358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a5429873148e7a386e67c717fa9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:03Z,use_quota=True,user_id='8ea0bb16951849dd93153e74bc6063c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c062fa6b-881b-4f47-87a2-7475db9355fd),volume_type_id=c062fa6b-881b-4f47-87a2-7475db9355fd)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:03 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da0a85f-6e5f-4c31-adf7-bc1ffed590e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da0a85f-6e5f-4c31-adf7-bc1ffed590e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d273921-3c2a-4edc-8016-f3d546529e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d273921-3c2a-4edc-8016-f3d546529e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ccbcd1-233c-42b0-a1c1-f749c4a4358f', 'volume_name': 'volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfb2ab3-0cd1-4a30-a868-8689365655b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dfb2ab3-0cd1-4a30-a868-8689365655b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a235d56-283b-4d66-9e74-9db36daa0fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Volume d0ccbcd1-233c-42b0-a1c1-f749c4a4358f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f', 'volume_size': 1} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=201152cf-5a3c-4a7e-8b4a-1f4bd9d5d5d3,created_at=2026-07-06T08:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-221704611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=201152cf-5a3c-4a7e-8b4a-1f4bd9d5d5d3,host='devstack@QuobyteHD#QuobyteHD',id=d0ccbcd1-233c-42b0-a1c1-f749c4a4358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4a5429873148e7a386e67c717fa9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:03Z,use_quota=True,user_id='8ea0bb16951849dd93153e74bc6063c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c062fa6b-881b-4f47-87a2-7475db9355fd),volume_type_id=c062fa6b-881b-4f47-87a2-7475db9355fd)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Creating volume d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:16:03 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.079s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Deleted volume successfully. Jul 06 10:16:03 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f 1073741824 Jul 06 10:16:03 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0555a00e-d923-4e72-a3ee-05a527435a74 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-4f9b4af9-72a0-401c-8e73-b52b0f997d52-delete_volume" released by "delete_volume" :: held 3.540s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:03 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd" returned: 0 in 1.165s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:03 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd Jul 06 10:16:03 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:04 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f 1073741824" returned: 0 in 1.139s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:04 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f Jul 06 10:16:04 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:04 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-quobyte-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd" released by "delete_volume" :: held 2.017s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Created reservations ['d91a6138-c49a-455b-ba26-a240c4a7ad75', 'd55d49ec-3493-4fee-9231-8cf670936cad', '45284df0-5a72-4828-a8e9-a5e0be4d0729', '9ac6ee96-7844-4169-8e2f-bb908bbe0342'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:04 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:16:04 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:05 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" returned: 0 in 0.818s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a235d56-283b-4d66-9e74-9db36daa0fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b29845f-517c-4ae8-bb8d-56cecf5d33b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Volume volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f (d0ccbcd1-233c-42b0-a1c1-f749c4a4358f): created successfully Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b29845f-517c-4ae8-bb8d-56cecf5d33b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Flow 'volume_create_manager' (605ea90a-8cbf-4e15-8664-8c91cc86069e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1719d364-7985-4785-856c-22f6f7d798e3 tempest-GroupSnapshotsV319Test-1275461289 None] Created volume successfully. Jul 06 10:16:05 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.682s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Deleted volume successfully. Jul 06 10:16:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-920dc50e-70e9-4ce3-9b48-717cfdb4b0d9 tempest-AttachVolumeTestJSON-1484649718 None] Lock "cinder-ea7f663e-36e4-427d-b0c6-1b026ae2a4cd-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] GroupSnapshot 73496ec6-4948-4f9a-bad7-0a32b5c95ef5: creating. Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Group snapshot 73496ec6-4948-4f9a-bad7-0a32b5c95ef5: creating. {{(pid=86456) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Creating offline snapshot 0b98506e-f601-40e7-a11a-d6e80ef3da39 of volume d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e753d2-a0b0-4efa-8dbb-9b4e9da7ea78]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:06 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f Jul 06 10:16:06 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:06 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" returned: 0 in 0.863s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:07 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 1G Jul 06 10:16:07 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:07 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 1G" returned: 0 in 0.985s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:08 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 Jul 06 10:16:08 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:08 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39" returned: 0 in 0.828s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:08 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:16:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:08 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 Jul 06 10:16:08 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:09 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39" returned: 0 in 0.810s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:09 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.info Jul 06 10:16:09 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:10 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.info" returned: 0 in 0.912s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:10 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 10:16:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:10 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.info Jul 06 10:16:10 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:11 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.info" returned: 0 in 1.006s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.521s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d862e5d2-be14-4aaf-a06c-e157b2d54c91 tempest-GroupSnapshotsV319Test-1275461289 None] group_snapshot 73496ec6-4948-4f9a-bad7-0a32b5c95ef5: created successfully Jul 06 10:16:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] group_snapshot 73496ec6-4948-4f9a-bad7-0a32b5c95ef5: deleting Jul 06 10:16:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] group_snapshot 73496ec6-4948-4f9a-bad7-0a32b5c95ef5: deleting {{(pid=86456) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 10:16:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Acquiring lock "cinder-quobyte-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Lock "cinder-quobyte-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Acquiring lock "cinder-quobyte-0b98506e-f601-40e7-a11a-d6e80ef3da39" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Lock "cinder-quobyte-0b98506e-f601-40e7-a11a-d6e80ef3da39" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Deleting offline snapshot 0b98506e-f601-40e7-a11a-d6e80ef3da39 of volume d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:16:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] snapshot_file for this snap is: volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:16:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f621252d-11ce-4450-9324-cbe88c289c38]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:13 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 Jul 06 10:16:13 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:14 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39" returned: 0 in 1.154s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:14 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:16:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60607a-9b09-4a78-aa3b-29bb25e289c7]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:14 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f Jul 06 10:16:14 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:15 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" returned: 0 in 1.188s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:15 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 Jul 06 10:16:15 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Flow 'volume_create_manager' (190f6509-97a8-4497-83b0-1c473d70aacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729cfc1b-4275-48dd-bd33-3bd75fe4209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729cfc1b-4275-48dd-bd33-3bd75fe4209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1343783450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece8de12-5da9-4388-b5a1-19919e268b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b20471b864a098bc2f93ab63dce02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:15Z,use_quota=True,user_id='35da6667e36443d1b6d04e6104014969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484cbaf1-060a-41c7-89d7-01b65ab0d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (484cbaf1-060a-41c7-89d7-01b65ab0d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85a66b-0867-47ca-8dcd-a66d9fe60e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a85a66b-0867-47ca-8dcd-a66d9fe60e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece8de12-5da9-4388-b5a1-19919e268b26', 'volume_name': 'volume-ece8de12-5da9-4388-b5a1-19919e268b26', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecc0586-9428-4b53-a869-72ad28a93496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecc0586-9428-4b53-a869-72ad28a93496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecd9d70-ba70-47ff-88fe-d65d4810b28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:15 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Volume ece8de12-5da9-4388-b5a1-19919e268b26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece8de12-5da9-4388-b5a1-19919e268b26', 'volume_size': 1} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1343783450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece8de12-5da9-4388-b5a1-19919e268b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b20471b864a098bc2f93ab63dce02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:15Z,use_quota=True,user_id='35da6667e36443d1b6d04e6104014969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Creating volume ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:16:15 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:16:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:15 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 1073741824 Jul 06 10:16:15 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:16 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39" returned: 0 in 1.335s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:16 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39 Jul 06 10:16:16 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:17 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 1073741824" returned: 0 in 1.352s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:17 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 Jul 06 10:16:17 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:17 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f.0b98506e-f601-40e7-a11a-d6e80ef3da39" returned: 0 in 0.764s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Lock "cinder-quobyte-0b98506e-f601-40e7-a11a-d6e80ef3da39" released by "_delete_snapshot" :: held 4.630s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Lock "cinder-quobyte-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" released by "delete_snapshot" :: held 4.666s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:17 devstack cinder-volume[86456]: WARNING cinder.quota [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-12438354 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-12438354, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:16:17 devstack cinder-volume[86456]: WARNING cinder.quota [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-12438354 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-12438354, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] Created reservations ['3a443a73-4e6b-4e34-a331-198180c2021e', '74c9b284-e618-4bf5-a1e4-355bb31771ef', '5c0807a9-cc4c-407e-ad85-2f716f7b0b7b', '46788a03-66d6-4fd3-87a0-c83ff1a32fcd'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d2d34145-429c-4547-83b6-b3979d0d818d tempest-GroupSnapshotsV319Test-1275461289 None] group_snapshot 73496ec6-4948-4f9a-bad7-0a32b5c95ef5: deleted successfully Jul 06 10:16:17 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26" returned: 0 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.242s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecd9d70-ba70-47ff-88fe-d65d4810b28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece8de12-5da9-4388-b5a1-19919e268b26', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161ca3dc-ccdb-4720-8afd-624cefa5b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:17 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Volume volume-ece8de12-5da9-4388-b5a1-19919e268b26 (ece8de12-5da9-4388-b5a1-19919e268b26): created successfully Jul 06 10:16:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161ca3dc-ccdb-4720-8afd-624cefa5b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Flow 'volume_create_manager' (190f6509-97a8-4497-83b0-1c473d70aacf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bbae3fa9-3c78-4fbc-9c50-c5abc550fba6 tempest-SnapshotDependencyTests-1109486864 None] Created volume successfully. Jul 06 10:16:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Acquiring lock "cinder-quobyte-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Lock "cinder-quobyte-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a443c-5bf7-47e9-9062-ead6bfc20fb0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Creating offline snapshot 9b7dca0e-9d3a-471c-93e6-1ff33c3c297b of volume ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:16:19 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f Jul 06 10:16:19 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:19 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baba1d9-5441-4fc5-9cfe-09faa1e6b1fa]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:19 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 Jul 06 10:16:19 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:19 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" returned: 0 in 0.933s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:19 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f Jul 06 10:16:19 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:20 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26" returned: 0 in 1.121s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:20 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b 1G Jul 06 10:16:20 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:20 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" returned: 0 in 0.937s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Lock "cinder-quobyte-d0ccbcd1-233c-42b0-a1c1-f749c4a4358f" released by "delete_volume" :: held 1.977s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:20 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Created reservations ['1e462f49-a661-4514-9e0e-52a2af2f4c4b'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:20 devstack cinder-volume[86456]: WARNING cinder.quota [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-12438354 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-12438354, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:16:20 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Created reservations ['feba9176-74ea-4410-a6e0-6a356ce4d0c5', '08d4e5dd-6e4c-40d9-8e2b-3a2bc9a2da29', 'cb41e79e-67d1-4ec5-abd4-0242a98eb869', 'c62a0d60-f1c1-43b2-8253-036d4699889f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:21 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:16:21 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:21 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b 1G" returned: 0 in 1.121s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8de12-5da9-4388-b5a1-19919e268b26 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:21 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8de12-5da9-4388-b5a1-19919e268b26 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b Jul 06 10:16:21 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:22 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.922s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:22 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d7a982d4-1e85-41a1-9387-0d6899bb91eb tempest-GroupSnapshotsV319Test-1275461289 None] Delete group completed successfully. Jul 06 10:16:22 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ece8de12-5da9-4388-b5a1-19919e268b26 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" returned: 0 in 0.856s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:22 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b is being set with open permissions: ugo+rw Jul 06 10:16:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:22 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b Jul 06 10:16:22 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:23 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" returned: 0 in 0.986s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:23 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.info Jul 06 10:16:23 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:24 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.info" returned: 0 in 0.945s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:24 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.info is being set with open permissions: ugo+rw Jul 06 10:16:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:24 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.info Jul 06 10:16:24 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:25 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.info" returned: 0 in 0.793s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.973s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-59a402c9-36c5-4b24-a086-6e021ab6d09d tempest-SnapshotDependencyTests-1109486864 None] Create snapshot completed successfully Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Flow 'volume_create_manager' (5614f90c-7f44-47f9-8a62-17eba37ec5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503376d3-4bfc-411c-ad03-7e8896a3bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503376d3-4bfc-411c-ad03-7e8896a3bdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6154a810-a53b-4e93-b3a3-6a76c4038ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b79b20471b864a098bc2f93ab63dce02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b7dca0e-9d3a-471c-93e6-1ff33c3c297b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:26Z,use_quota=True,user_id='35da6667e36443d1b6d04e6104014969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0e7a9e-24f6-45e8-8b0c-61389cc9de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0e7a9e-24f6-45e8-8b0c-61389cc9de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b4186e-508f-45a5-85fb-1d6199fc9083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b4186e-508f-45a5-85fb-1d6199fc9083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6154a810-a53b-4e93-b3a3-6a76c4038ddd', 'volume_name': 'volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd', 'volume_size': 1, 'snapshot_id': '9b7dca0e-9d3a-471c-93e6-1ff33c3c297b'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5dac0d-abbf-4c57-9911-8fff8379a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5dac0d-abbf-4c57-9911-8fff8379a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0488a957-fa99-4410-8479-9e3569b86c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:26 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Volume 6154a810-a53b-4e93-b3a3-6a76c4038ddd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd', 'volume_size': 1, 'snapshot_id': '9b7dca0e-9d3a-471c-93e6-1ff33c3c297b'} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-quobyte-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b-6154a810-a53b-4e93-b3a3-6a76c4038ddd" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b-6154a810-a53b-4e93-b3a3-6a76c4038ddd" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Creating volume 6154a810-a53b-4e93-b3a3-6a76c4038ddd from snapshot 9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-quobyte-6154a810-a53b-4e93-b3a3-6a76c4038ddd" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-6154a810-a53b-4e93-b3a3-6a76c4038ddd" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] snapshot: 9b7dca0e-9d3a-471c-93e6-1ff33c3c297b, volume: 6154a810-a53b-4e93-b3a3-6a76c4038ddd, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12e356b-cf91-4cbe-9524-f2659f7ba615]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:26 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b Jul 06 10:16:26 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:27 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" returned: 0 in 0.960s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece8de12-5da9-4388-b5a1-19919e268b26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:16:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:16:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:16:27 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46126a6-fc2b-42a4-ba33-18786dfbeadc]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:27 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 Jul 06 10:16:27 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:28 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26" returned: 0 in 0.920s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:28 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd Jul 06 10:16:28 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=106,cinder:UPDATE=105,cinder:INSERT=28,cinder:DELETE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=101,cinder:UPDATE=104,cinder:DELETE=8,cinder:INSERT=22 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Flow 'volume_create_manager' (c40ed0ef-ad88-4003-899d-ea03f8ccca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1f6e1c-6809-46fa-b8bf-3e6fdb32e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1f6e1c-6809-46fa-b8bf-3e6fdb32e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-620233790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5395781-e7c8-4c67-8c25-4fb51af5e527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9036aa9f5f54da28430c22b32009ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:29Z,use_quota=True,user_id='313a879d7fe6428d8a67df6a7d82f410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67478c27-0f35-4b84-94ea-6a8a4296179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67478c27-0f35-4b84-94ea-6a8a4296179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1472badf-0e09-493e-8a5d-d3b7548ffcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1472badf-0e09-493e-8a5d-d3b7548ffcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5395781-e7c8-4c67-8c25-4fb51af5e527', 'volume_name': 'volume-e5395781-e7c8-4c67-8c25-4fb51af5e527', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9371f12-bc30-4bdd-b03a-97bd3f9f20d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9371f12-bc30-4bdd-b03a-97bd3f9f20d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6febe97-ff10-4ce3-94bc-32b0e4be7a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Volume e5395781-e7c8-4c67-8c25-4fb51af5e527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5395781-e7c8-4c67-8c25-4fb51af5e527', 'volume_size': 1} Jul 06 10:16:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:34 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd" returned: 0 in 5.657s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d123ff4-f50e-4376-b7d0-e806a77279d2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:34 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 Jul 06 10:16:34 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:35 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26" returned: 0 in 1.058s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:16:35 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Converted 1024.00 MB image at 180.98 MB/s Jul 06 10:16:35 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd is being set with open permissions: ugo+rw Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:35 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd Jul 06 10:16:35 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:35 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-6154a810-a53b-4e93-b3a3-6a76c4038ddd" released by "_copy_volume_from_snapshot" :: held 9.418s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b-6154a810-a53b-4e93-b3a3-6a76c4038ddd" released by "_create_volume_from_snapshot" :: held 9.459s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.481s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.871s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-620233790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5395781-e7c8-4c67-8c25-4fb51af5e527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9036aa9f5f54da28430c22b32009ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:29Z,use_quota=True,user_id='313a879d7fe6428d8a67df6a7d82f410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Creating volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:16:35 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:35 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 1073741824 Jul 06 10:16:35 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0488a957-fa99-4410-8479-9e3569b86c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd', 'volume_size': 1, 'snapshot_id': '9b7dca0e-9d3a-471c-93e6-1ff33c3c297b'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1686c56b-673a-4b23-9b24-94fbf0e1587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:35 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Volume volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd (6154a810-a53b-4e93-b3a3-6a76c4038ddd): created successfully Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1686c56b-673a-4b23-9b24-94fbf0e1587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Flow 'volume_create_manager' (5614f90c-7f44-47f9-8a62-17eba37ec5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e796192e-b537-4b83-bf94-3324d058418a tempest-SnapshotDependencyTests-1109486864 None] Created volume successfully. Jul 06 10:16:36 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 1073741824" returned: 0 in 0.904s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:36 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 Jul 06 10:16:36 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-quobyte-ece8de12-5da9-4388-b5a1-19919e268b26" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-ece8de12-5da9-4388-b5a1-19919e268b26" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-quobyte-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Deleting offline snapshot 9b7dca0e-9d3a-471c-93e6-1ff33c3c297b of volume ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] snapshot_file for this snap is: volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b67e2a-4f8b-4971-b459-692df5f9c00b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:37 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b Jul 06 10:16:37 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:37 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6febe97-ff10-4ce3-94bc-32b0e4be7a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5395781-e7c8-4c67-8c25-4fb51af5e527', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16a0561-2311-4961-9bd9-df640aa1fee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Volume volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 (e5395781-e7c8-4c67-8c25-4fb51af5e527): created successfully Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16a0561-2311-4961-9bd9-df640aa1fee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Flow 'volume_create_manager' (c40ed0ef-ad88-4003-899d-ea03f8ccca32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-981f7ef4-aa6e-4228-91ab-13c22a87c20b tempest-SnapshotsActionsTest-493375282 None] Created volume successfully. Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Creating offline snapshot 08813f2f-d380-4d46-9f28-567d4f854fd7 of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32ab44-aae4-4919-b2af-7976a5b7dae7]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:38 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" returned: 0 in 1.072s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ece8de12-5da9-4388-b5a1-19919e268b26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f0221-f098-4e99-a8ad-4ffbf03abfb9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:38 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 Jul 06 10:16:38 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:38 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 Jul 06 10:16:38 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:39 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527" returned: 0 in 0.917s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:39 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 1G Jul 06 10:16:39 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:39 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26" returned: 0 in 1.056s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:39 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b Jul 06 10:16:39 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:40 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" returned: 0 in 1.157s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:40 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b Jul 06 10:16:40 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:40 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 1G" returned: 0 in 1.509s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:40 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:16:40 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:41 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26.9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" returned: 0 in 0.809s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b" released by "_delete_snapshot" :: held 4.239s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-ece8de12-5da9-4388-b5a1-19919e268b26" released by "delete_snapshot" :: held 4.269s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:41 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Created reservations ['dad2b703-39f4-4996-9234-6ff6056d6ed4', '93ac2c64-c894-4c59-b93c-667cba44c555', '963f5203-3122-4b5e-9b35-adcbd9aa8165', 'b4cfc581-37b9-4d42-a405-e0f858456b2d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Delete snapshot completed successfully. Jul 06 10:16:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-15e1d450-1a3d-41db-9991-34ca49151979 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-9b7dca0e-9d3a-471c-93e6-1ff33c3c297b-delete_snapshot" released by "delete_snapshot" :: held 4.559s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:41 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 1.037s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:41 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 is being set with open permissions: ugo+rw Jul 06 10:16:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:41 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:16:41 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-ece8de12-5da9-4388-b5a1-19919e268b26-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:42 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-ece8de12-5da9-4388-b5a1-19919e268b26-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.825s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-quobyte-ece8de12-5da9-4388-b5a1-19919e268b26" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-ece8de12-5da9-4388-b5a1-19919e268b26" acquired by "delete_volume" :: waited 0.033s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:42 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.info Jul 06 10:16:42 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2164f03a-45e1-48e5-b4bd-2594fccf4322]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:42 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 Jul 06 10:16:42 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:43 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.info" returned: 0 in 0.751s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:43 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.info is being set with open permissions: ugo+rw Jul 06 10:16:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:43 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.info Jul 06 10:16:43 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:43 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26" returned: 0 in 1.080s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:43 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26 Jul 06 10:16:43 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:44 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.info" returned: 0 in 0.939s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.156s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-db44d60f-671d-45cd-845d-066100d24e19 tempest-SnapshotsActionsTest-493375282 None] Create snapshot completed successfully Jul 06 10:16:44 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ece8de12-5da9-4388-b5a1-19919e268b26" returned: 0 in 0.983s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-ece8de12-5da9-4388-b5a1-19919e268b26" released by "delete_volume" :: held 2.151s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:44 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Created reservations ['8c5e4608-893f-4c6a-b308-ab751b11c399', 'fd78e150-0770-4b6e-a6e9-b376ead3765d', 'd4561626-a436-4bba-b1ae-0cd63e757248', '2dbae8fa-4bf1-4eee-9d22-1db93c9c09c2'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:45 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:16:45 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:45 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.896s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:45 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Deleted volume successfully. Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2626b27e-bbfb-45b0-9c0e-0c2a6550ae53 tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-ece8de12-5da9-4388-b5a1-19919e268b26-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-6154a810-a53b-4e93-b3a3-6a76c4038ddd-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-6154a810-a53b-4e93-b3a3-6a76c4038ddd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "cinder-quobyte-6154a810-a53b-4e93-b3a3-6a76c4038ddd" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-6154a810-a53b-4e93-b3a3-6a76c4038ddd" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e7099-e191-4fa4-8f1f-d8e6df986ffb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:46 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd Jul 06 10:16:46 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Creating offline snapshot 9f7a452c-1fcd-4cc7-8b84-5a89784a36eb of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fc1047-049e-4ba6-bbe5-f2f9f0b760b7]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:46 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:16:46 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:47 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd" returned: 0 in 1.004s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:47 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd Jul 06 10:16:47 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:47 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 1.013s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:16:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:47 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb 1G Jul 06 10:16:47 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:48 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6154a810-a53b-4e93-b3a3-6a76c4038ddd" returned: 0 in 0.813s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-quobyte-6154a810-a53b-4e93-b3a3-6a76c4038ddd" released by "delete_volume" :: held 1.884s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Created reservations ['8644c454-34a1-42e9-a1ac-b16f5c6baaf6', 'dc9029b5-1d1d-42fa-8048-341134d7cbba', 'c337b3b2-f300-4a58-ae2b-91d099fda0da', '7d7f88b2-8018-4575-a608-ebb6a2bacca4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:48 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:16:48 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:48 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb 1G" returned: 0 in 1.151s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:49 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb Jul 06 10:16:49 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:49 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.920s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:49 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Deleted volume successfully. Jul 06 10:16:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b752748b-b316-422a-af13-bea42c33c3bf tempest-SnapshotDependencyTests-1109486864 None] Lock "cinder-6154a810-a53b-4e93-b3a3-6a76c4038ddd-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:49 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" returned: 0 in 1.040s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:50 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb is being set with open permissions: ugo+rw Jul 06 10:16:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:50 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb Jul 06 10:16:50 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:50 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" returned: 0 in 0.817s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:50 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f615d8e8-9d5d-4c83-a2be-9748168adc71 tempest-SnapshotsActionsTest-493375282 None] Create snapshot completed successfully Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Flow 'volume_create_manager' (e3cfc3de-d063-48e4-907f-0f7e4bec8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931a5f3-39a0-4d8a-b3a5-7530b95b0841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8931a5f3-39a0-4d8a-b3a5-7530b95b0841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2112415469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d667fe6-5dcd-433a-8ac4-187bb0fec6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e46af378b6e4576a275eb783dc571a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:51Z,use_quota=True,user_id='16110f55dd634e3fba6e12e9575b418e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b5c4c7-81d5-43d2-90fd-7018699c7f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0b5c4c7-81d5-43d2-90fd-7018699c7f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d073470b-a929-406e-8f70-06a6095ec58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d073470b-a929-406e-8f70-06a6095ec58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d667fe6-5dcd-433a-8ac4-187bb0fec6f2', 'volume_name': 'volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f006dfef-8b61-4eda-8d7e-991aab6fde7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f006dfef-8b61-4eda-8d7e-991aab6fde7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2c1c5e-2c1d-42d1-9fda-caa221f3242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:51 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Volume 3d667fe6-5dcd-433a-8ac4-187bb0fec6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2', 'volume_size': 1} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2112415469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d667fe6-5dcd-433a-8ac4-187bb0fec6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e46af378b6e4576a275eb783dc571a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:51Z,use_quota=True,user_id='16110f55dd634e3fba6e12e9575b418e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Creating volume 3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:16:51 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:16:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:51 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 1073741824 Jul 06 10:16:51 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-9f7a452c-1fcd-4cc7-8b84-5a89784a36eb-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-9f7a452c-1fcd-4cc7-8b84-5a89784a36eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Deleting offline snapshot 9f7a452c-1fcd-4cc7-8b84-5a89784a36eb of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:16:52 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] snapshot_file for this snap is: volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 1073741824" returned: 0 in 1.043s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d0777-0fd3-43b8-9b32-a3707729ae12]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:52 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 Jul 06 10:16:52 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:52 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb Jul 06 10:16:52 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:53 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2c1c5e-2c1d-42d1-9fda-caa221f3242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcebe3a-108e-4167-ae67-b90915d12d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:53 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Volume volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 (3d667fe6-5dcd-433a-8ac4-187bb0fec6f2): created successfully Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcebe3a-108e-4167-ae67-b90915d12d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Flow 'volume_create_manager' (e3cfc3de-d063-48e4-907f-0f7e4bec8718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:53 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e352269b-bade-4a87-9bee-a6572db4f892 tempest-VolumeQuotasAdminTestJSON-441154570 None] Created volume successfully. Jul 06 10:16:53 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" returned: 0 in 0.968s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0acfc10-574c-49dc-b1dc-adc077628089]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:53 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:16:53 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Acquiring lock "cinder-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "cinder-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Acquiring lock "cinder-quobyte-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "cinder-quobyte-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c93ac5-2958-40d1-a748-939e078596a4]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:53 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 Jul 06 10:16:53 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:54 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.807s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:16:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:54 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb Jul 06 10:16:54 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:54 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2" returned: 0 in 0.837s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:54 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2 Jul 06 10:16:54 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:55 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" returned: 0 in 0.935s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:55 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb Jul 06 10:16:55 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:55 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2" returned: 0 in 0.716s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "cinder-quobyte-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2" released by "delete_volume" :: held 1.606s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Created reservations ['0c15e84d-bdc7-4e33-b43a-d61447b7b5ad', '39d97f3b-ad95-4bad-8e8c-5b3bbaef1000', '0c5fa099-0cad-499c-94e5-578c646741b7', '307aa0da-5709-43c5-aeb0-396502644e25'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:55 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:16:55 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:55 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" returned: 0 in 0.723s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-9f7a452c-1fcd-4cc7-8b84-5a89784a36eb" released by "_delete_snapshot" :: held 3.554s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" released by "delete_snapshot" :: held 3.582s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:55 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Created reservations ['251e6030-3eef-4bbe-9720-87d385c1e1e4', 'c0fd9811-65d3-4655-a96d-31bd3083391a', '2cc84ce6-42a2-4db5-9146-fd2033f17417', 'b50fd907-00bd-4f94-8b6b-061477882f5b'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:16:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Delete snapshot completed successfully. Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-01a66b17-8b2e-4f36-b1c7-92f3a1586d32 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-9f7a452c-1fcd-4cc7-8b84-5a89784a36eb-delete_snapshot" released by "delete_snapshot" :: held 3.818s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:56 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.975s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:16:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Deleted volume successfully. Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7536e39a-8bb8-45ca-be6c-bb5f4ef0f481 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "cinder-3d667fe6-5dcd-433a-8ac4-187bb0fec6f2-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Flow 'volume_create_manager' (42b06dd5-f4b2-4780-9aed-2ab68bee592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b864eb9-55dc-4663-9485-95d22e9eef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b864eb9-55dc-4663-9485-95d22e9eef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-908809041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ef0b2-7374-483b-b8c5-5da25551a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e46af378b6e4576a275eb783dc571a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:56Z,use_quota=True,user_id='16110f55dd634e3fba6e12e9575b418e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f16c38-572d-4cba-b56e-144740b292ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f16c38-572d-4cba-b56e-144740b292ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3931867-8f94-4852-a7d9-9e8485409164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3931867-8f94-4852-a7d9-9e8485409164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314ef0b2-7374-483b-b8c5-5da25551a9f6', 'volume_name': 'volume-314ef0b2-7374-483b-b8c5-5da25551a9f6', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585fca0f-5375-4238-949c-73a08760dfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585fca0f-5375-4238-949c-73a08760dfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad91ed7d-f678-434e-a743-cdf780f4d4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Volume 314ef0b2-7374-483b-b8c5-5da25551a9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314ef0b2-7374-483b-b8c5-5da25551a9f6', 'volume_size': 1} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-908809041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ef0b2-7374-483b-b8c5-5da25551a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e46af378b6e4576a275eb783dc571a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:16:56Z,use_quota=True,user_id='16110f55dd634e3fba6e12e9575b418e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Creating volume 314ef0b2-7374-483b-b8c5-5da25551a9f6 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:16:56 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:56 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 1073741824 Jul 06 10:16:56 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:16:57 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 1073741824" returned: 0 in 0.985s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:57 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 Jul 06 10:16:57 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:58 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6" returned: 0 in 0.731s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.555s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad91ed7d-f678-434e-a743-cdf780f4d4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314ef0b2-7374-483b-b8c5-5da25551a9f6', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d52966-3ca7-4192-9a35-db68f8847a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Creating offline snapshot 38c83efc-90f3-4b09-b5fc-b6c7943bf5de of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:16:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Volume volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 (314ef0b2-7374-483b-b8c5-5da25551a9f6): created successfully Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d52966-3ca7-4192-9a35-db68f8847a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Flow 'volume_create_manager' (42b06dd5-f4b2-4780-9aed-2ab68bee592b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c750e1-5710-43f4-9cff-53292f64ecd3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c32bd9f2-4b5f-4a00-908c-be8c1b85da32 tempest-VolumeQuotasAdminTestJSON-441154570 None] Created volume successfully. Jul 06 10:16:58 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:16:58 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:16:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:16:59 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 06 10:16:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.917s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:16:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:16:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:16:59 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de 1G Jul 06 10:16:59 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:00 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de 1G" returned: 0 in 0.863s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:00 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de Jul 06 10:17:00 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fcab6999-9676-414b-96c3-12dcd761516b tempest-VolumeQuotasAdminTestJSON-319721074 None] Transfer volume completed successfully. Jul 06 10:17:00 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de" returned: 0 in 0.650s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:00 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de is being set with open permissions: ugo+rw Jul 06 10:17:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:00 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de Jul 06 10:17:00 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Acquiring lock "cinder-314ef0b2-7374-483b-b8c5-5da25551a9f6-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Lock "cinder-314ef0b2-7374-483b-b8c5-5da25551a9f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Acquiring lock "cinder-quobyte-314ef0b2-7374-483b-b8c5-5da25551a9f6" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Lock "cinder-quobyte-314ef0b2-7374-483b-b8c5-5da25551a9f6" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f49904c-d647-4f8a-ac82-dc942b426f9e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:01 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 Jul 06 10:17:01 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:01 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de" returned: 0 in 0.662s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.254s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8adced5a-b97c-403c-9698-a6feb420065c tempest-SnapshotsActionsTest-493375282 None] Create snapshot completed successfully Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-38c83efc-90f3-4b09-b5fc-b6c7943bf5de-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-38c83efc-90f3-4b09-b5fc-b6c7943bf5de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-38c83efc-90f3-4b09-b5fc-b6c7943bf5de" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-38c83efc-90f3-4b09-b5fc-b6c7943bf5de" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Deleting offline snapshot 38c83efc-90f3-4b09-b5fc-b6c7943bf5de of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:17:02 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] snapshot_file for this snap is: volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6" returned: 0 in 0.824s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b2b72e-6398-42ac-8f90-162c5b16b465]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:02 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6 Jul 06 10:17:02 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:02 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de Jul 06 10:17:02 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:03 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-314ef0b2-7374-483b-b8c5-5da25551a9f6" returned: 0 in 0.736s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Lock "cinder-quobyte-314ef0b2-7374-483b-b8c5-5da25551a9f6" released by "delete_volume" :: held 1.617s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Created reservations ['fb757d16-8948-4da3-971a-d25a24f6ea92', '6c7faf39-125f-495b-9087-f6f8958757c2', 'ffcb6dae-9b52-4c7b-9551-18440e68d234', '35e6e96e-ad21-4611-b7a5-3dae577752c4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:03 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de" returned: 0 in 0.921s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:03 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:17:03 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d540ecc-f000-423e-bd91-49d4e8b46ff2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:03 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:03 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:04 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.947s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:04 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:17:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Deleted volume successfully. Jul 06 10:17:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6c8f80c1-20f3-463b-8097-3095fbd38e39 tempest-VolumeQuotasAdminTestJSON-1949395946 None] Lock "cinder-314ef0b2-7374-483b-b8c5-5da25551a9f6-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:04 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 1.152s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:04 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de Jul 06 10:17:04 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:05 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de" returned: 0 in 0.807s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:05 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de Jul 06 10:17:05 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-832fb3a2-ef1d-4e95-bd20-6f2bc9db7b9e req-0435e262-a905-4551-8e76-e428c5d3e5b6 tempest-TestMinimumBasicScenario-1846108167 None] Terminate volume connection completed successfully. Jul 06 10:17:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-832fb3a2-ef1d-4e95-bd20-6f2bc9db7b9e req-0435e262-a905-4551-8e76-e428c5d3e5b6 tempest-TestMinimumBasicScenario-1846108167 None] Deleting attachment 1295bfb4-4d3f-4058-917f-c305ec2bb0aa. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:17:06 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.38c83efc-90f3-4b09-b5fc-b6c7943bf5de" returned: 0 in 0.814s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-38c83efc-90f3-4b09-b5fc-b6c7943bf5de" released by "_delete_snapshot" :: held 3.797s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" released by "delete_snapshot" :: held 3.825s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Created reservations ['b267bbaa-b9f3-493e-9709-a17badd740fe', '6af20b0a-8e33-4577-983a-76e1da9a9dc9', '38c69c79-bad8-42da-963d-abfb0071aa90', 'd313f52b-6d25-4ac2-b24a-2397882dd19d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Delete snapshot completed successfully. Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d90026b6-d825-4d72-b85b-7f675b66ee04 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-38c83efc-90f3-4b09-b5fc-b6c7943bf5de-delete_snapshot" released by "delete_snapshot" :: held 3.973s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Creating offline snapshot 837b6a63-ce7d-46ed-8e71-3e8d837bf391 of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b571a5-cc87-4c38-ba8d-f6cee55a9f5c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:07 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:07 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:07 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.885s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:07 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 1G Jul 06 10:17:07 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Acquiring lock "cinder-8c83de3c-558b-4db2-91bb-8ed9f9106008-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Lock "cinder-8c83de3c-558b-4db2-91bb-8ed9f9106008-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Acquiring lock "cinder-quobyte-8c83de3c-558b-4db2-91bb-8ed9f9106008" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Lock "cinder-quobyte-8c83de3c-558b-4db2-91bb-8ed9f9106008" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46f5293-5226-4979-9299-4b9378f1aad3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:08 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 Jul 06 10:17:08 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:08 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 1G" returned: 0 in 0.978s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:08 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 Jul 06 10:17:08 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:09 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008" returned: 0 in 0.876s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:09 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008 Jul 06 10:17:09 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:09 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391" returned: 0 in 0.728s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:09 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 is being set with open permissions: ugo+rw Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:09 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 Jul 06 10:17:09 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:09 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8c83de3c-558b-4db2-91bb-8ed9f9106008" returned: 0 in 0.664s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Lock "cinder-quobyte-8c83de3c-558b-4db2-91bb-8ed9f9106008" released by "delete_volume" :: held 1.588s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Created reservations ['f0101c92-845a-46de-ac41-8222f1691dc6', 'a2de15ab-93bf-4858-9a0c-d3319b6a6482', '72774f20-8524-4ead-b111-5e7a8286f35e', 'f687d560-d857-4882-8b11-c2b92da642c8'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:09 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:17:09 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:10 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.380s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-929ef71b-eaeb-4b16-b3ab-6063e901ddb9 tempest-SnapshotsActionsTest-493375282 None] Create snapshot completed successfully Jul 06 10:17:10 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.790s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:10 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:17:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Deleted volume successfully. Jul 06 10:17:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de170eea-58b7-4527-9bf6-ffd11d45b386 tempest-TestMinimumBasicScenario-1846108167 None] Lock "cinder-8c83de3c-558b-4db2-91bb-8ed9f9106008-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-837b6a63-ce7d-46ed-8e71-3e8d837bf391-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-837b6a63-ce7d-46ed-8e71-3e8d837bf391-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-837b6a63-ce7d-46ed-8e71-3e8d837bf391" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-837b6a63-ce7d-46ed-8e71-3e8d837bf391" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Deleting offline snapshot 837b6a63-ce7d-46ed-8e71-3e8d837bf391 of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] snapshot_file for this snap is: volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acd26e7-59ff-48d3-8ccc-905d2a78ba39]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Flow 'volume_create_manager' (10b98670-a0d2-48a8-bed9-9d68e1599f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02c3d5f-9899-44d5-b771-592148865bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02c3d5f-9899-44d5-b771-592148865bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1754931445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fae22a7-a7c2-4076-8f7b-9d1314b0c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0230092e62ac4a77a9adbeaac3693025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:11Z,use_quota=True,user_id='fdaf0a2cd7254d13b28c7eb55bb8acb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e473dc-7d9f-41c6-a8b1-1ec52841b448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e473dc-7d9f-41c6-a8b1-1ec52841b448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e714d8-9100-4f45-bbbc-1f69d3f6cd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:11 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 Jul 06 10:17:11 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74e714d8-9100-4f45-bbbc-1f69d3f6cd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fae22a7-a7c2-4076-8f7b-9d1314b0c423', 'volume_name': 'volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a500d19e-81f2-4a83-925f-32775da3cda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a500d19e-81f2-4a83-925f-32775da3cda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e037bb1-0d37-47a0-964c-f984e00a3d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:11 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Volume 9fae22a7-a7c2-4076-8f7b-9d1314b0c423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423', 'volume_size': 1} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1754931445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fae22a7-a7c2-4076-8f7b-9d1314b0c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0230092e62ac4a77a9adbeaac3693025',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:11Z,use_quota=True,user_id='fdaf0a2cd7254d13b28c7eb55bb8acb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Creating volume 9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:17:11 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:17:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:11 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 1073741824 Jul 06 10:17:11 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:12 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391" returned: 0 in 0.814s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd18da8-cdce-4d76-a477-e191cdf07796]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:12 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:12 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:12 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 1073741824" returned: 0 in 1.047s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:12 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 Jul 06 10:17:12 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:13 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 1.054s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:13 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 Jul 06 10:17:13 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:13 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" returned: 0 in 0.740s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e037bb1-0d37-47a0-964c-f984e00a3d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0ecd45-abf5-434d-b613-dc240a248a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:13 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Volume volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 (9fae22a7-a7c2-4076-8f7b-9d1314b0c423): created successfully Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0ecd45-abf5-434d-b613-dc240a248a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Flow 'volume_create_manager' (10b98670-a0d2-48a8-bed9-9d68e1599f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-034e4c5a-988a-4f10-b9a9-5d65bf9e9a0e tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Created volume successfully. Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Creating offline snapshot da6bfb81-1a65-456f-b42e-985fb7eb4dd0 of volume 9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8dd91-5c93-49d9-bdb2-3213530b8a83]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:13 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 Jul 06 10:17:13 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:14 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391" returned: 0 in 0.916s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:14 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391 Jul 06 10:17:14 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:14 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:14 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 1G Jul 06 10:17:14 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:14 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.837b6a63-ce7d-46ed-8e71-3e8d837bf391" returned: 0 in 0.672s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-837b6a63-ce7d-46ed-8e71-3e8d837bf391" released by "_delete_snapshot" :: held 3.557s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" released by "delete_snapshot" :: held 3.583s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Created reservations ['da8a67f6-58c6-4190-b064-5092e969c9ab', 'b566e301-ccde-411f-835c-88236ce4919e', 'b6a59c41-efef-479c-a8ea-b5783aeefb80', 'f4237e44-61ea-4a1b-bfe8-d063909048f6'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:14 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Delete snapshot completed successfully. Jul 06 10:17:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0a88a59-11b2-4dc9-aa79-00798301088b tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-837b6a63-ce7d-46ed-8e71-3e8d837bf391-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:15 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 1G" returned: 0 in 0.808s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:15 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 Jul 06 10:17:15 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:16 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0" returned: 0 in 0.694s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:16 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 is being set with open permissions: ugo+rw Jul 06 10:17:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:16 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 Jul 06 10:17:16 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:16 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0" returned: 0 in 0.658s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:16 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.info Jul 06 10:17:16 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:17 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.info" returned: 0 in 0.693s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:17 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.info is being set with open permissions: ugo+rw Jul 06 10:17:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:17 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.info Jul 06 10:17:17 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:18 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.info" returned: 0 in 0.650s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.382s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.359s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Creating offline snapshot ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:17:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e29a8ad5-5205-47b0-930a-59ef25de641d tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Create snapshot completed successfully Jul 06 10:17:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af0c6a5-adee-453c-a43b-b28c67dbcce3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:18 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:18 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:19 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.813s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:19 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 1G Jul 06 10:17:19 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "cinder-da6bfb81-1a65-456f-b42e-985fb7eb4dd0-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-da6bfb81-1a65-456f-b42e-985fb7eb4dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "cinder-quobyte-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-quobyte-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "cinder-quobyte-da6bfb81-1a65-456f-b42e-985fb7eb4dd0" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-quobyte-da6bfb81-1a65-456f-b42e-985fb7eb4dd0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Deleting offline snapshot da6bfb81-1a65-456f-b42e-985fb7eb4dd0 of volume 9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] snapshot_file for this snap is: volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9508920c-c411-4aca-8f9e-0607a6d60232]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:19 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 Jul 06 10:17:19 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:19 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 1G" returned: 0 in 0.893s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:19 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 Jul 06 10:17:19 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:20 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0" returned: 0 in 0.866s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:20 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b25628-b473-4efb-b8aa-08e828e74322]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:20 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 Jul 06 10:17:20 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:20 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" returned: 0 in 0.731s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:20 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 is being set with open permissions: ugo+rw Jul 06 10:17:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:20 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 Jul 06 10:17:20 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:21 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" returned: 0 in 0.677s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:21 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.250s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" returned: 0 in 0.957s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:21 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 Jul 06 10:17:21 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-43f70210-7791-4e65-b729-4b9fd5b3c419 tempest-SnapshotsActionsTest-493375282 None] Create snapshot completed successfully Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-ba9d5038-a7d7-414e-9a9f-ac2c812d8f87-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-ba9d5038-a7d7-414e-9a9f-ac2c812d8f87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:22 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0" returned: 0 in 0.803s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Acquiring lock "cinder-quobyte-ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:22 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0 Jul 06 10:17:22 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Deleting offline snapshot ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] snapshot_file for this snap is: volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0adc282-9263-4540-9590-ef3435daabfd]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:22 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 Jul 06 10:17:22 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:22 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423.da6bfb81-1a65-456f-b42e-985fb7eb4dd0" returned: 0 in 0.714s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-quobyte-da6bfb81-1a65-456f-b42e-985fb7eb4dd0" released by "_delete_snapshot" :: held 3.461s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-quobyte-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" released by "delete_snapshot" :: held 3.489s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Created reservations ['7b0067f9-3982-4ec4-aa2d-51275ae21725', '9b7bcfda-8656-4f62-8dcb-1ecf30700d33', '6fbef8d2-1601-4a84-95a8-5ed66d2dce7b', '79c8d297-becd-4edb-87fc-3c4cf2c1eecd'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Delete snapshot completed successfully. Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8ffeb13b-bffa-4250-acdc-9ccf640410bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-da6bfb81-1a65-456f-b42e-985fb7eb4dd0-delete_snapshot" released by "delete_snapshot" :: held 3.634s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:23 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" returned: 0 in 0.841s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[74db1777-9cdb-49be-a1de-fe2841e8daf4]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:23 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:23 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "cinder-9fae22a7-a7c2-4076-8f7b-9d1314b0c423-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-9fae22a7-a7c2-4076-8f7b-9d1314b0c423-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "cinder-quobyte-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-quobyte-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76b47c5-c322-43b1-a2ef-d4dbb2c8d142]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:23 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.815s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:23 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 Jul 06 10:17:23 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:23 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 Jul 06 10:17:23 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:24 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" returned: 0 in 0.801s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:24 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423 Jul 06 10:17:24 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:24 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" returned: 0 in 0.794s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:24 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87 Jul 06 10:17:24 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:25 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" returned: 0 in 0.692s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-ba9d5038-a7d7-414e-9a9f-ac2c812d8f87" released by "_delete_snapshot" :: held 3.248s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" released by "delete_snapshot" :: held 3.278s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:25 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" returned: 0 in 0.869s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-quobyte-9fae22a7-a7c2-4076-8f7b-9d1314b0c423" released by "delete_volume" :: held 1.734s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Created reservations ['d69c37aa-fd4d-4579-b288-7ea179cf8a07', 'eb7e0889-31c0-4088-82e8-d857bcfa00e2', '93e5756d-3a6b-4321-8b28-b336ed26b270', 'f9a5b129-4791-4209-a078-2e13c6c7bbec'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Delete snapshot completed successfully. Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dabb3253-6625-48a7-acae-202924682ff6 tempest-SnapshotsActionsTest-582816726 None] Lock "cinder-ba9d5038-a7d7-414e-9a9f-ac2c812d8f87-delete_snapshot" released by "delete_snapshot" :: held 3.482s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Created reservations ['e29bb4af-bf9f-4cfe-9323-64c5776ab177', '7f704311-d7c6-416d-b3df-a01bb10a0551', '651cf06b-1ee4-41de-be7d-8a5e82bcfa96', 'eace4f34-de68-48ee-bed4-ed5d63f00d15'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:25 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:17:25 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:26 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.832s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:17:26 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Deleted volume successfully. Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8df0d997-eebe-4b5d-be26-44c34a80b242 tempest-VolumeSnapshotQuotasNegativeTestJSON-1330775835 None] Lock "cinder-9fae22a7-a7c2-4076-8f7b-9d1314b0c423-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "cinder-08813f2f-d380-4d46-9f28-567d4f854fd7-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-08813f2f-d380-4d46-9f28-567d4f854fd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "cinder-quobyte-08813f2f-d380-4d46-9f28-567d4f854fd7" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-quobyte-08813f2f-d380-4d46-9f28-567d4f854fd7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Deleting offline snapshot 08813f2f-d380-4d46-9f28-567d4f854fd7 of volume e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] snapshot_file for this snap is: volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4576c2-2df4-4539-b6f4-9ced060607e8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:27 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:27 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:27 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.906s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5395781-e7c8-4c67-8c25-4fb51af5e527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:17:27 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39112d7-e65c-492f-8235-cb150047c786]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:28 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 Jul 06 10:17:28 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:28 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527" returned: 0 in 0.873s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:28 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:28 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:29 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:29 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7 Jul 06 10:17:29 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:30 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527.08813f2f-d380-4d46-9f28-567d4f854fd7" returned: 0 in 0.670s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:30 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=95,cinder:UPDATE=97,cinder:DELETE=10,cinder:INSERT=27 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:17:30 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=105,cinder:SELECT=78,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:17:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-quobyte-08813f2f-d380-4d46-9f28-567d4f854fd7" released by "_delete_snapshot" :: held 3.429s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" released by "delete_snapshot" :: held 3.454s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:30 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Created reservations ['53955d4a-8c92-4eb2-bc9e-6fedd835a09c', '71a19697-f97b-46a1-9364-464ae6a5155c', 'c9cb724a-bbe9-45b2-95f9-09d33b2c3046', 'a427c0ab-8575-4316-88fb-3fd071ca93e8'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Delete snapshot completed successfully. Jul 06 10:17:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fbc1bb18-3af5-4f8d-9f21-fa35d2dee211 tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-08813f2f-d380-4d46-9f28-567d4f854fd7-delete_snapshot" released by "delete_snapshot" :: held 3.611s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "cinder-e5395781-e7c8-4c67-8c25-4fb51af5e527-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-e5395781-e7c8-4c67-8c25-4fb51af5e527-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69ab975-b9c6-490c-9257-7bc4b501bad6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:31 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 Jul 06 10:17:31 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:32 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527" returned: 0 in 0.888s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:32 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527 Jul 06 10:17:32 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Flow 'volume_create_manager' (599cd6d5-23b9-4056-8bfe-540d3feaffc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7534d-1eb9-4f84-bf9a-261ebef1fa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7534d-1eb9-4f84-bf9a-261ebef1fa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-21691781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43c74b8-2bce-472b-9f13-32ac3de9bd72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e081d13cf94a648ebf16a39487312c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:33Z,use_quota=True,user_id='3998806564e14d55b1914fcecb60cffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f35704d-3cdb-489c-9a2b-38c40c03f87b),volume_type_id=8f35704d-3cdb-489c-9a2b-38c40c03f87b)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a5ddb2-f929-4d37-b6ac-bc49d670840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a5ddb2-f929-4d37-b6ac-bc49d670840e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e389e24d-fec8-4f82-a901-769234217189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e389e24d-fec8-4f82-a901-769234217189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c43c74b8-2bce-472b-9f13-32ac3de9bd72', 'volume_name': 'volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b40cce1-13f9-4d3d-b7f8-df6c78978e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b40cce1-13f9-4d3d-b7f8-df6c78978e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e33a06-d370-4cd9-807c-a9fedbeb4e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Volume c43c74b8-2bce-472b-9f13-32ac3de9bd72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72', 'volume_size': 1} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-21691781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c43c74b8-2bce-472b-9f13-32ac3de9bd72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e081d13cf94a648ebf16a39487312c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:33Z,use_quota=True,user_id='3998806564e14d55b1914fcecb60cffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f35704d-3cdb-489c-9a2b-38c40c03f87b),volume_type_id=8f35704d-3cdb-489c-9a2b-38c40c03f87b)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Creating volume c43c74b8-2bce-472b-9f13-32ac3de9bd72 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:17:33 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:33 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e5395781-e7c8-4c67-8c25-4fb51af5e527" returned: 0 in 0.754s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:33 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 1073741824 Jul 06 10:17:33 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-quobyte-e5395781-e7c8-4c67-8c25-4fb51af5e527" released by "delete_volume" :: held 1.734s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Created reservations ['b952f467-9d06-4dfe-80bc-6c1d775bd023', 'c1bc350d-20df-4715-aa1c-0068f46c8b55', '2bcc6611-2da7-44da-852f-b6907f3544d0', '8fba63f5-2fc8-40e8-b7b4-dfa558b8a3cf'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:33 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:17:33 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Flow 'volume_create_manager' (9fb23c5b-a2f2-4d42-9ab5-d42269259cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d2bb94-5663-4378-a7fc-cd9ff41f8ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d2bb94-5663-4378-a7fc-cd9ff41f8ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fc195a62ba4f4f8547b085431b591e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:34Z,use_quota=True,user_id='9780788e1456424e8450434cceb46553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069bcf53-a8f0-4648-91f8-cfeefdf1ef23),volume_type_id=069bcf53-a8f0-4648-91f8-cfeefdf1ef23)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0bee55-32e0-41a0-b0dd-879ace51ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0bee55-32e0-41a0-b0dd-879ace51ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c525d49-2c21-46b8-9864-0f04a5682057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:17:33 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:17:33 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Deleted volume successfully. Jul 06 10:17:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b78cb459-3143-45cd-8a3a-7ec8e1ab621e tempest-SnapshotsActionsTest-493375282 None] Lock "cinder-e5395781-e7c8-4c67-8c25-4fb51af5e527-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:34 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 1073741824" returned: 0 in 0.991s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:34 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 Jul 06 10:17:34 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c525d49-2c21-46b8-9864-0f04a5682057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8a8b1cc-f7b1-4e29-a3fc-651c18c6990a', 'volume_name': 'volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a', 'volume_size': 1, 'image_id': '8d4183df-9d0d-4332-a29e-058ee54ecb26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d4183df-9d0d-4332-a29e-058ee54ecb26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd1471b61e136b8cf1621619b381bb66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50fc195a62ba4f4f8547b085431b591e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba5566588e3404c32196f669ad764893a4d55562c3efa3917963369687e629122011b46d4de30af8ede019ae560607ed411e80e1b7ddb58c624ae09e2fe194df', 'id': '8d4183df-9d0d-4332-a29e-058ee54ecb26', 'created_at': datetime.datetime(2026, 7, 6, 8, 17, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 17, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d4183df-9d0d-4332-a29e-058ee54ecb26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd65dae-21a4-410e-b622-7efd477ef9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd65dae-21a4-410e-b622-7efd477ef9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa93b4d-5c82-448f-a508-0b23ef287ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Volume d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a', 'volume_size': 1, 'image_id': '8d4183df-9d0d-4332-a29e-058ee54ecb26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d4183df-9d0d-4332-a29e-058ee54ecb26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd1471b61e136b8cf1621619b381bb66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50fc195a62ba4f4f8547b085431b591e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba5566588e3404c32196f669ad764893a4d55562c3efa3917963369687e629122011b46d4de30af8ede019ae560607ed411e80e1b7ddb58c624ae09e2fe194df', 'id': '8d4183df-9d0d-4332-a29e-058ee54ecb26', 'created_at': datetime.datetime(2026, 7, 6, 8, 17, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 17, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d4183df-9d0d-4332-a29e-058ee54ecb26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Trying to clone d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a from image 8d4183df-9d0d-4332-a29e-058ee54ecb26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d4183df-9d0d-4332-a29e-058ee54ecb26', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:17:34 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Image download 0.00 MB at 0.00 MB/s Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7fc196-0ef3-4145-9ac6-4f961e7e4a33]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:34 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD Jul 06 10:17:34 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:34 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72" returned: 0 in 0.731s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e33a06-d370-4cd9-807c-a9fedbeb4e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bcda2c-7108-43a1-a430-46751a1d45aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Volume volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 (c43c74b8-2bce-472b-9f13-32ac3de9bd72): created successfully Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bcda2c-7108-43a1-a430-46751a1d45aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Flow 'volume_create_manager' (599cd6d5-23b9-4056-8bfe-540d3feaffc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-59f773fb-dcb4-4d45-887f-28255bb30d8e tempest-VolumeTypesAccessTest-1428317807 None] Created volume successfully. Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Acquiring lock "cinder-c43c74b8-2bce-472b-9f13-32ac3de9bd72-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Lock "cinder-c43c74b8-2bce-472b-9f13-32ac3de9bd72-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Acquiring lock "cinder-quobyte-c43c74b8-2bce-472b-9f13-32ac3de9bd72" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Lock "cinder-quobyte-c43c74b8-2bce-472b-9f13-32ac3de9bd72" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ff0a4-f4f0-4390-9724-756833e4a18b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:35 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 Jul 06 10:17:35 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:35 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD" returned: 0 in 0.963s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:35 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD Jul 06 10:17:35 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:36 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72" returned: 0 in 0.830s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:36 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72 Jul 06 10:17:36 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:36 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD" returned: 1 in 0.889s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Temporary image 8d4183df-9d0d-4332-a29e-058ee54ecb26 is fetched for user 9780788e1456424e8450434cceb46553. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9398315f-024a-4ae8-a1cf-bdf753b96e09]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:36 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD Jul 06 10:17:36 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:36 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c43c74b8-2bce-472b-9f13-32ac3de9bd72" returned: 0 in 0.741s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Lock "cinder-quobyte-c43c74b8-2bce-472b-9f13-32ac3de9bd72" released by "delete_volume" :: held 1.632s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:36 devstack cinder-volume[86456]: WARNING cinder.quota [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-558482682 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-558482682, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:17:36 devstack cinder-volume[86456]: WARNING cinder.quota [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-558482682 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-558482682, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Created reservations ['5d8ae2a1-4f2b-49cf-9ca2-27d02d3758bf', '832c0a90-ed65-4b44-ba1c-4f0dbc01957b', '76087d52-a2a1-44b8-b10f-662c94cbb947', '925822c2-f841-4f4f-88fe-4935203853b7'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:36 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:17:36 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:37 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD" returned: 0 in 0.760s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:37 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD Jul 06 10:17:37 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:37 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.704s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:17:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Deleted volume successfully. Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d60f4067-379a-4316-91ca-b7a24f8f86c3 tempest-VolumeTypesAccessTest-1428317807 None] Lock "cinder-c43c74b8-2bce-472b-9f13-32ac3de9bd72-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:37 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD" returned: 1 in 0.834s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fc195a62ba4f4f8547b085431b591e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:34Z,use_quota=True,user_id='9780788e1456424e8450434cceb46553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(069bcf53-a8f0-4648-91f8-cfeefdf1ef23),volume_type_id=069bcf53-a8f0-4648-91f8-cfeefdf1ef23)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Creating volume d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:17:37 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:17:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:38 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a 1073741824 Jul 06 10:17:38 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:38 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a 1073741824" returned: 0 in 0.962s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:39 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a Jul 06 10:17:39 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:39 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" returned: 0 in 0.729s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:17:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:39 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Attempting download of 8d4183df-9d0d-4332-a29e-058ee54ecb26 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d4183df-9d0d-4332-a29e-058ee54ecb26', 'metadata': {}}])) to volume d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:17:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b37a66-b74f-4374-95e5-edd60ffc5499]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d4183df-9d0d-4332-a29e-058ee54ecb26_6r0m84da {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:39 devstack sudo[98104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d4183df-9d0d-4332-a29e-058ee54ecb26_6r0m84da Jul 06 10:17:39 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:40 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d4183df-9d0d-4332-a29e-058ee54ecb26_6r0m84da" returned: 0 in 0.809s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4183df-9d0d-4332-a29e-058ee54ecb26_6r0m84da {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:40 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4183df-9d0d-4332-a29e-058ee54ecb26_6r0m84da Jul 06 10:17:40 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:41 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4183df-9d0d-4332-a29e-058ee54ecb26_6r0m84da" returned: 1 in 0.863s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d4183df-9d0d-4332-a29e-058ee54ecb26_6r0m84da' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:17:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b9a5b-0c1b-4930-9541-b6d30431d8c0]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:41 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD Jul 06 10:17:41 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:42 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD" returned: 0 in 0.844s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:42 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD Jul 06 10:17:42 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:43 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD" returned: 1 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:17:43 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] 8d4183df-9d0d-4332-a29e-058ee54ecb26 was raw, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:17:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:43 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a Jul 06 10:17:43 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:43 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" returned: 0 in 0.803s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:43 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d4183df-9d0d-4332-a29e-058ee54ecb26_sa2r6hb_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:17:43 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 10:17:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:43 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a 1G Jul 06 10:17:43 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:44 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a 1G" returned: 0 in 0.794s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:44 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3f476-6e43-4352-a705-3fca3a9dc907]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:44 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a Jul 06 10:17:44 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:45 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" returned: 0 in 0.772s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:45 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a Jul 06 10:17:45 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:46 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" returned: 1 in 0.869s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Downloaded image 8d4183df-9d0d-4332-a29e-058ee54ecb26 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d4183df-9d0d-4332-a29e-058ee54ecb26', 'metadata': {}}])) to volume d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Temporary image 8d4183df-9d0d-4332-a29e-058ee54ecb26 for user 9780788e1456424e8450434cceb46553 is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Marking volume d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Copying metadata from image 8d4183df-9d0d-4332-a29e-058ee54ecb26 to d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Creating volume glance metadata for volume d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a backed by image 8d4183df-9d0d-4332-a29e-058ee54ecb26 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8d4183df-9d0d-4332-a29e-058ee54ecb26', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dd1471b61e136b8cf1621619b381bb66', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa93b4d-5c82-448f-a508-0b23ef287ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a', 'volume_size': 1, 'image_id': '8d4183df-9d0d-4332-a29e-058ee54ecb26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d4183df-9d0d-4332-a29e-058ee54ecb26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd1471b61e136b8cf1621619b381bb66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50fc195a62ba4f4f8547b085431b591e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba5566588e3404c32196f669ad764893a4d55562c3efa3917963369687e629122011b46d4de30af8ede019ae560607ed411e80e1b7ddb58c624ae09e2fe194df', 'id': '8d4183df-9d0d-4332-a29e-058ee54ecb26', 'created_at': datetime.datetime(2026, 7, 6, 8, 17, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 17, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d4183df-9d0d-4332-a29e-058ee54ecb26/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9111edf1-afae-4513-abff-c245a4eadf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:46 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Volume volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a (d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a): created successfully Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9111edf1-afae-4513-abff-c245a4eadf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Flow 'volume_create_manager' (9fb23c5b-a2f2-4d42-9ab5-d42269259cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9b600f69-4b99-4318-9f33-487bb304cebc tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Created volume successfully. Jul 06 10:17:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Acquiring lock "cinder-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "cinder-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Acquiring lock "cinder-quobyte-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:17:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "cinder-quobyte-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:17:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc060f51-89e4-491e-9742-b96db84114ca]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:17:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:47 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a Jul 06 10:17:47 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:48 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:48 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a Jul 06 10:17:48 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:49 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" returned: 1 in 0.894s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:17:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:49 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a Jul 06 10:17:49 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:50 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" returned: 0 in 0.735s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "cinder-quobyte-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a" released by "delete_volume" :: held 2.637s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:50 devstack cinder-volume[86456]: WARNING cinder.quota [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:17:50 devstack cinder-volume[86456]: WARNING cinder.quota [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Created reservations ['137d2e90-eac8-4777-b983-e307159219a8', '30caa3c8-49c1-462c-a93f-658396122ad8', '694a4685-991d-4676-a9ef-4ab8747b4f15', 'f57c29d1-29ec-4186-86ed-87110c1c43f3'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:50 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:17:50 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:51 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.819s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:51 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:17:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Deleted volume successfully. Jul 06 10:17:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5604f5bf-aad9-4d75-a959-108d257f3b78 tempest-VolumeAndVolumeTypeFromImageTest-1515616433 None] Lock "cinder-d8a8b1cc-f7b1-4e29-a3fc-651c18c6990a-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Flow 'volume_create_manager' (228bb384-bbd2-424a-b927-bb6753338107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c65eeb-f971-446e-bf27-68abd0effca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c65eeb-f971-446e-bf27-68abd0effca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1113106360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525ef378-cd2c-4c93-9f09-36085b129eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ed2a56394ddead9e9ef05a7ff3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:52Z,use_quota=True,user_id='0f29f5291b134b8a885d437348e9bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073bdd1f-2124-4c64-9c5f-ce52aeba8bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073bdd1f-2124-4c64-9c5f-ce52aeba8bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679ee56d-16e2-47d3-ba5c-86c05a3d3d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679ee56d-16e2-47d3-ba5c-86c05a3d3d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525ef378-cd2c-4c93-9f09-36085b129eb5', 'volume_name': 'volume-525ef378-cd2c-4c93-9f09-36085b129eb5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849406c9-63a4-4106-a550-f258d89aaee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849406c9-63a4-4106-a550-f258d89aaee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bd57b8-8e71-488c-824e-36dbe3117103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Volume 525ef378-cd2c-4c93-9f09-36085b129eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525ef378-cd2c-4c93-9f09-36085b129eb5', 'volume_size': 1} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1113106360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525ef378-cd2c-4c93-9f09-36085b129eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ed2a56394ddead9e9ef05a7ff3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:52Z,use_quota=True,user_id='0f29f5291b134b8a885d437348e9bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Creating volume 525ef378-cd2c-4c93-9f09-36085b129eb5 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:17:52 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:17:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:52 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 1073741824 Jul 06 10:17:52 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:53 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 1073741824" returned: 0 in 0.976s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:53 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 Jul 06 10:17:53 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:54 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5" returned: 0 in 0.851s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:17:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bd57b8-8e71-488c-824e-36dbe3117103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525ef378-cd2c-4c93-9f09-36085b129eb5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c6852d-7e94-4f67-b083-b587e13884af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:54 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Volume volume-525ef378-cd2c-4c93-9f09-36085b129eb5 (525ef378-cd2c-4c93-9f09-36085b129eb5): created successfully Jul 06 10:17:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c6852d-7e94-4f67-b083-b587e13884af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Flow 'volume_create_manager' (228bb384-bbd2-424a-b927-bb6753338107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:54 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d8e03ef0-247f-4398-a0e3-e32ebeba5319 tempest-VolumesListAdminTestJSON-2079656350 None] Created volume successfully. Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Flow 'volume_create_manager' (b1ff58b2-7dbe-4ffc-a619-0d4b225aaf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9522c5-015b-4688-a415-5ef9d4de20de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9522c5-015b-4688-a415-5ef9d4de20de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-386849819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9d6818-8eed-46f8-ab72-befba0d01a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ed2a56394ddead9e9ef05a7ff3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:56Z,use_quota=True,user_id='0f29f5291b134b8a885d437348e9bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6978b17-b186-4cec-abf5-08d5ba9380cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6978b17-b186-4cec-abf5-08d5ba9380cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5b4b4e-bba7-4e09-af7f-80da7ae29654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5b4b4e-bba7-4e09-af7f-80da7ae29654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f9d6818-8eed-46f8-ab72-befba0d01a5d', 'volume_name': 'volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10deb0e-d133-4bcd-9f1e-4681830a6afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10deb0e-d133-4bcd-9f1e-4681830a6afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593da5fd-7e83-4df6-b1bd-744c4de42d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Volume 4f9d6818-8eed-46f8-ab72-befba0d01a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d', 'volume_size': 1} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-386849819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f9d6818-8eed-46f8-ab72-befba0d01a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ed2a56394ddead9e9ef05a7ff3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:56Z,use_quota=True,user_id='0f29f5291b134b8a885d437348e9bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Creating volume 4f9d6818-8eed-46f8-ab72-befba0d01a5d {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:17:56 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:56 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d 1073741824 Jul 06 10:17:56 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (0d6072ae-1ef8-4e9a-b3d7-4fd362399544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c695f95-1f08-47dd-abd9-539f6500c533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c695f95-1f08-47dd-abd9-539f6500c533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-574514708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061b8b7c-8d47-429f-8a92-0b66cebc38f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:56Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed072645-1752-401a-a48f-c9347e8d6688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed072645-1752-401a-a48f-c9347e8d6688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa9b047-525a-4bbf-a27a-457815bbbb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa9b047-525a-4bbf-a27a-457815bbbb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061b8b7c-8d47-429f-8a92-0b66cebc38f5', 'volume_name': 'volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee50d48-9e4f-486d-8c6a-7075ca0d3c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee50d48-9e4f-486d-8c6a-7075ca0d3c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffe54cb-8351-4b7a-b1b2-4fd193deb11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Volume 061b8b7c-8d47-429f-8a92-0b66cebc38f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5', 'volume_size': 1} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (01739df8-025b-44b4-92ba-8f30527daf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c21c35-dfe4-4dde-a87e-d5e66b1e76b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c21c35-dfe4-4dde-a87e-d5e66b1e76b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737396753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a24300-3380-4b0b-9d5b-6af9917da1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:57Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf0aa6-c8da-4e89-a2c2-c9c40a76965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bf0aa6-c8da-4e89-a2c2-c9c40a76965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944412f4-bf95-41bb-8dd0-4484e50deef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944412f4-bf95-41bb-8dd0-4484e50deef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a24300-3380-4b0b-9d5b-6af9917da1fc', 'volume_name': 'volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6c07d1-b52d-4293-bc1e-e02ca006624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6c07d1-b52d-4293-bc1e-e02ca006624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca18c9b-1da7-4dd7-b92a-320da1b9ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:57 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Volume a0a24300-3380-4b0b-9d5b-6af9917da1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc', 'volume_size': 1} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (fded85d9-0282-46bf-893d-c71752a56b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473f6f8b-ecb5-4aed-b5bd-5e100d7ae1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473f6f8b-ecb5-4aed-b5bd-5e100d7ae1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2093715535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5497fc80-623d-4d3e-a43e-7c6c516125c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:57Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67acdfce-9c67-42e9-aeca-fa83b909c33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67acdfce-9c67-42e9-aeca-fa83b909c33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf085f2-bac4-4c1e-8080-71a90e034e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf085f2-bac4-4c1e-8080-71a90e034e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5497fc80-623d-4d3e-a43e-7c6c516125c0', 'volume_name': 'volume-5497fc80-623d-4d3e-a43e-7c6c516125c0', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:57 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0a550c-8729-4aee-a67f-6d708950fc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0a550c-8729-4aee-a67f-6d708950fc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224c9065-ae55-4213-bd9f-570ae1c7ce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:57 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Volume 5497fc80-623d-4d3e-a43e-7c6c516125c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5497fc80-623d-4d3e-a43e-7c6c516125c0', 'volume_size': 1} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d 1073741824" returned: 0 in 1.301s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:57 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d Jul 06 10:17:57 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (144d797f-8af3-4ee5-b32c-32762445b726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a330d7-ba33-4935-ae40-2b2305e9bbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a330d7-ba33-4935-ae40-2b2305e9bbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439969864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a5b471-629c-4c0d-bd06-9cd1a214b795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:58Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7209b7e2-4412-466b-a6b3-75a58f6287fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7209b7e2-4412-466b-a6b3-75a58f6287fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1caba494-1688-4303-89da-ec541ad372b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1caba494-1688-4303-89da-ec541ad372b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a5b471-629c-4c0d-bd06-9cd1a214b795', 'volume_name': 'volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47dc589-30d0-46b4-a661-2875083e8d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47dc589-30d0-46b4-a661-2875083e8d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2fcc8b-e7b4-4283-94ac-dfd9cef4996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Volume e2a5b471-629c-4c0d-bd06-9cd1a214b795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795', 'volume_size': 1} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (959a1075-6619-4676-8179-3a5924c08ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda2df06-81e9-4903-b6cd-38e68ccd3652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda2df06-81e9-4903-b6cd-38e68ccd3652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336399336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197cdf2b-e3b0-44a0-bfc0-54c5a52d7049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:58Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9f8dee-f456-425f-a909-b4721fa92b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9f8dee-f456-425f-a909-b4721fa92b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6f28cf-176a-46db-a047-c099eb72a039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6f28cf-176a-46db-a047-c099eb72a039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197cdf2b-e3b0-44a0-bfc0-54c5a52d7049', 'volume_name': 'volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf5f3ca-f9a1-4a2f-804d-7421e41875cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf5f3ca-f9a1-4a2f-804d-7421e41875cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045c4238-8a78-4fad-90e5-56cc5c1ef328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Volume 197cdf2b-e3b0-44a0-bfc0-54c5a52d7049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049', 'volume_size': 1} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:58 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.064s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-574514708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061b8b7c-8d47-429f-8a92-0b66cebc38f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:56Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Creating volume 061b8b7c-8d47-429f-8a92-0b66cebc38f5 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:17:58 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:58 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 1073741824 Jul 06 10:17:58 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593da5fd-7e83-4df6-b1bd-744c4de42d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4ec66f-58a7-48c3-a821-b22aa353ee96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:17:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Volume volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d (4f9d6818-8eed-46f8-ab72-befba0d01a5d): created successfully Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4ec66f-58a7-48c3-a821-b22aa353ee96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Flow 'volume_create_manager' (b1ff58b2-7dbe-4ffc-a619-0d4b225aaf2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:17:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-91958464-61f1-48eb-a885-8bd9c51d6333 tempest-VolumesListAdminTestJSON-2079656350 None] Created volume successfully. Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:17:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:58 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:17:58 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:59 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 1073741824" returned: 0 in 1.070s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:17:59 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 06 10:17:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.778s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:17:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:17:59 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 Jul 06 10:17:59 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:17:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:17:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 28 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:17:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Flow 'volume_create_manager' (362c22e9-f1d2-4839-a3c7-10b3793c01b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1f9d62-b594-4d9e-a7a5-eb8e5877ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1f9d62-b594-4d9e-a7a5-eb8e5877ad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-724749633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6aebfd-a621-4517-89e5-4dd9a9179153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ed2a56394ddead9e9ef05a7ff3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:00Z,use_quota=True,user_id='0f29f5291b134b8a885d437348e9bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3884dba5-92e3-4099-8d57-4d8edcd03e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3884dba5-92e3-4099-8d57-4d8edcd03e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d4b317-2040-4cdf-a2a9-5a2b694e0ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d4b317-2040-4cdf-a2a9-5a2b694e0ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a6aebfd-a621-4517-89e5-4dd9a9179153', 'volume_name': 'volume-8a6aebfd-a621-4517-89e5-4dd9a9179153', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9e7b81-3e84-4cee-8703-382165bd38f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9e7b81-3e84-4cee-8703-382165bd38f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52b668c-2f3d-4d13-a18a-903b98908e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:00 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Volume 8a6aebfd-a621-4517-89e5-4dd9a9179153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a6aebfd-a621-4517-89e5-4dd9a9179153', 'volume_size': 1} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:00 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5" returned: 0 in 0.768s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.442s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1737396753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a24300-3380-4b0b-9d5b-6af9917da1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:57Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Creating volume a0a24300-3380-4b0b-9d5b-6af9917da1fc {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:00 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:00 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc 1073741824 Jul 06 10:18:00 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cffe54cb-8351-4b7a-b1b2-4fd193deb11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613fdfb1-c7dd-48aa-b03c-ceb41d488114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:00 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Volume volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 (061b8b7c-8d47-429f-8a92-0b66cebc38f5): created successfully Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (613fdfb1-c7dd-48aa-b03c-ceb41d488114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (0d6072ae-1ef8-4e9a-b3d7-4fd362399544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6ce2d3ee-db0e-4715-a9e1-86356a36f014 tempest-CreateVolumesFromImageTest-305868580 None] Created volume successfully. Jul 06 10:18:01 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc 1073741824" returned: 0 in 0.957s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:01 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc Jul 06 10:18:01 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:02 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc" returned: 0 in 0.806s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.743s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2093715535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5497fc80-623d-4d3e-a43e-7c6c516125c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:57Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Creating volume 5497fc80-623d-4d3e-a43e-7c6c516125c0 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:02 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:02 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 1073741824 Jul 06 10:18:02 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca18c9b-1da7-4dd7-b92a-320da1b9ab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6096abb-7a9c-4884-bfdc-2fb0baf92e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:02 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Volume volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc (a0a24300-3380-4b0b-9d5b-6af9917da1fc): created successfully Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6096abb-7a9c-4884-bfdc-2fb0baf92e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (01739df8-025b-44b4-92ba-8f30527daf85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7c9bde42-d47c-4d6d-b962-3eaa20b58d4b tempest-CreateVolumesFromImageTest-305868580 None] Created volume successfully. Jul 06 10:18:03 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 1073741824" returned: 0 in 0.888s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:03 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 Jul 06 10:18:03 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:03 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0" returned: 0 in 0.674s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.814s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439969864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a5b471-629c-4c0d-bd06-9cd1a214b795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:58Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Creating volume e2a5b471-629c-4c0d-bd06-9cd1a214b795 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:03 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224c9065-ae55-4213-bd9f-570ae1c7ce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5497fc80-623d-4d3e-a43e-7c6c516125c0', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:03 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 1073741824 Jul 06 10:18:03 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfcdb03-42a6-4924-8e76-4b0184b69f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Volume volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 (5497fc80-623d-4d3e-a43e-7c6c516125c0): created successfully Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfcdb03-42a6-4924-8e76-4b0184b69f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (fded85d9-0282-46bf-893d-c71752a56b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ab87c054-88e1-4c76-bd4b-07d254bce93d tempest-CreateVolumesFromImageTest-305868580 None] Created volume successfully. Jul 06 10:18:04 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 1073741824" returned: 0 in 0.976s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:04 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 Jul 06 10:18:04 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:05 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795" returned: 0 in 0.647s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.086s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336399336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197cdf2b-e3b0-44a0-bfc0-54c5a52d7049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d5bd20785c446b9fe3270054d20d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:17:58Z,use_quota=True,user_id='c69bb6eb2cd1411eaca8f67132360905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Creating volume 197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:05 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:05 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 1073741824 Jul 06 10:18:05 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2fcc8b-e7b4-4283-94ac-dfd9cef4996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d9222-88e5-4429-baf5-10944c31938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Volume volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 (e2a5b471-629c-4c0d-bd06-9cd1a214b795): created successfully Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176d9222-88e5-4429-baf5-10944c31938c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (144d797f-8af3-4ee5-b32c-32762445b726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cefa6b75-2b9b-4e69-96c5-51afc5ace51c tempest-CreateVolumesFromImageTest-305868580 None] Created volume successfully. Jul 06 10:18:06 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 1073741824" returned: 0 in 0.947s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:06 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 Jul 06 10:18:06 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:07 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049" returned: 0 in 0.759s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.251s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-724749633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a6aebfd-a621-4517-89e5-4dd9a9179153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c6ed2a56394ddead9e9ef05a7ff3ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:00Z,use_quota=True,user_id='0f29f5291b134b8a885d437348e9bbf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Creating volume 8a6aebfd-a621-4517-89e5-4dd9a9179153 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:07 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045c4238-8a78-4fad-90e5-56cc5c1ef328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:07 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 1073741824 Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9add1be7-3a65-4d26-a011-7f56df4cb814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:07 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:07 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Volume volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 (197cdf2b-e3b0-44a0-bfc0-54c5a52d7049): created successfully Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9add1be7-3a65-4d26-a011-7f56df4cb814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Flow 'volume_create_manager' (959a1075-6619-4676-8179-3a5924c08ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9f742f42-2330-4f20-97d0-e26044bf96b9 tempest-CreateVolumesFromImageTest-305868580 None] Created volume successfully. Jul 06 10:18:08 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 1073741824" returned: 0 in 0.934s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:08 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 Jul 06 10:18:08 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-quobyte-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[079942e0-120e-4733-ace4-0718322f9d87]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:08 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 Jul 06 10:18:08 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:09 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153" returned: 0 in 0.740s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52b668c-2f3d-4d13-a18a-903b98908e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a6aebfd-a621-4517-89e5-4dd9a9179153', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74f6665-4276-46e0-bcd6-6250d2a531ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:09 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Volume volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 (8a6aebfd-a621-4517-89e5-4dd9a9179153): created successfully Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74f6665-4276-46e0-bcd6-6250d2a531ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Flow 'volume_create_manager' (362c22e9-f1d2-4839-a3c7-10b3793c01b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:09 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ce5d537a-1775-4914-be27-0a8c5d659146 tempest-VolumesListAdminTestJSON-2079656350 None] Created volume successfully. Jul 06 10:18:09 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049" returned: 0 in 0.878s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:09 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049 Jul 06 10:18:09 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:10 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049" returned: 0 in 0.662s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049" released by "delete_volume" :: held 1.596s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Created reservations ['c890ccfd-b571-417f-9e9a-5cc819d7beae', '1833338d-c717-4b00-8dae-52605e682d2b', 'a4c1d35b-5715-47bb-9a1f-0adc48384748', '716a2f1e-1dea-4aca-bd17-032c5a2460aa'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:10 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:10 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Flow 'volume_create_manager' (aa5b851e-583f-42a4-a486-939427ad9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3446f1d-efbb-439d-9704-fc9f8186849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3446f1d-efbb-439d-9704-fc9f8186849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a87208-473c-44fe-bd53-21de4421bc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc90339006749b09d7a31389e4b8d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:10Z,use_quota=True,user_id='25211c512b554713988a049fa6c0ec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b5a9b9-d680-4efa-9ae1-510995f09b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b5a9b9-d680-4efa-9ae1-510995f09b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b768c9ad-1311-4fe0-934c-c5796bd1df83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b768c9ad-1311-4fe0-934c-c5796bd1df83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a87208-473c-44fe-bd53-21de4421bc72', 'volume_name': 'volume-19a87208-473c-44fe-bd53-21de4421bc72', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2b9426-5641-4b3c-899f-1a953c62fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2b9426-5641-4b3c-899f-1a953c62fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd82671-6d0b-41da-97ff-68d81485b996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:10 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Volume 19a87208-473c-44fe-bd53-21de4421bc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a87208-473c-44fe-bd53-21de4421bc72', 'volume_size': 1} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a87208-473c-44fe-bd53-21de4421bc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc90339006749b09d7a31389e4b8d19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:10Z,use_quota=True,user_id='25211c512b554713988a049fa6c0ec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Creating volume 19a87208-473c-44fe-bd53-21de4421bc72 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:10 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-e2a5b471-629c-4c0d-bd06-9cd1a214b795-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:10 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 1073741824 Jul 06 10:18:10 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-e2a5b471-629c-4c0d-bd06-9cd1a214b795-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-quobyte-e2a5b471-629c-4c0d-bd06-9cd1a214b795" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-e2a5b471-629c-4c0d-bd06-9cd1a214b795" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a875608-bf2e-4bc7-ba4c-3d9e1193b65e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:10 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 Jul 06 10:18:10 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:10 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.778s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:11 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Deleted volume successfully. Jul 06 10:18:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9504f584-7e5c-4e6c-ba34-3e9bcc3e1c06 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-197cdf2b-e3b0-44a0-bfc0-54c5a52d7049-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:11 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:11 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 1073741824" returned: 0 in 0.993s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:11 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795 Jul 06 10:18:11 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:11 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 Jul 06 10:18:11 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:12 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e2a5b471-629c-4c0d-bd06-9cd1a214b795" returned: 0 in 0.703s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-e2a5b471-629c-4c0d-bd06-9cd1a214b795" released by "delete_volume" :: held 1.586s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:12 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72" returned: 0 in 0.680s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd82671-6d0b-41da-97ff-68d81485b996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a87208-473c-44fe-bd53-21de4421bc72', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cbbf74-86d6-4da1-a68e-84a4d57cc9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:12 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Volume volume-19a87208-473c-44fe-bd53-21de4421bc72 (19a87208-473c-44fe-bd53-21de4421bc72): created successfully Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93cbbf74-86d6-4da1-a68e-84a4d57cc9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Flow 'volume_create_manager' (aa5b851e-583f-42a4-a486-939427ad9e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-418f2e81-ae1d-4786-80de-b9a97ff43fec tempest-VolumesListAdminTestJSON-1863298446 None] Created volume successfully. Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Created reservations ['0c504790-08d1-4d25-b2eb-23f7faaf0283', 'bdd9c9f5-0883-45ab-b560-f30c7e3e50f4', '9292e203-2b2b-477e-976a-279275f3d099', '1b1297ea-4dbd-4107-bdb6-1059993b854c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:12 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:12 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Acquiring lock "cinder-19a87208-473c-44fe-bd53-21de4421bc72-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Lock "cinder-19a87208-473c-44fe-bd53-21de4421bc72-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Acquiring lock "cinder-quobyte-19a87208-473c-44fe-bd53-21de4421bc72" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Lock "cinder-quobyte-19a87208-473c-44fe-bd53-21de4421bc72" acquired by "delete_volume" :: waited 0.013s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b5aff7-ecef-4387-ae24-0bf36ff2839f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-5497fc80-623d-4d3e-a43e-7c6c516125c0-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "cinder-8a6aebfd-a621-4517-89e5-4dd9a9179153-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-8a6aebfd-a621-4517-89e5-4dd9a9179153-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-5497fc80-623d-4d3e-a43e-7c6c516125c0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-quobyte-5497fc80-623d-4d3e-a43e-7c6c516125c0" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "cinder-quobyte-8a6aebfd-a621-4517-89e5-4dd9a9179153" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:13 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 Jul 06 10:18:13 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-5497fc80-623d-4d3e-a43e-7c6c516125c0" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-quobyte-8a6aebfd-a621-4517-89e5-4dd9a9179153" acquired by "delete_volume" :: waited 0.059s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[077776f5-c895-4188-b56e-93396beafa26]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e34d1-d17a-42f0-8547-fd35edbd615b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:13 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 Jul 06 10:18:13 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:13 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 Jul 06 10:18:13 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:13 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.164s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Deleted volume successfully. Jul 06 10:18:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1cb41c7c-f719-4298-bc63-b7e617727e66 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-e2a5b471-629c-4c0d-bd06-9cd1a214b795-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:14 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72" returned: 0 in 1.212s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:14 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72 Jul 06 10:18:14 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:14 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153" returned: 0 in 1.289s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:14 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153 Jul 06 10:18:14 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:14 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0" returned: 0 in 1.429s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:14 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0 Jul 06 10:18:14 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:15 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-19a87208-473c-44fe-bd53-21de4421bc72" returned: 0 in 1.067s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Lock "cinder-quobyte-19a87208-473c-44fe-bd53-21de4421bc72" released by "delete_volume" :: held 2.349s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Created reservations ['5f109728-a305-4677-a39d-846905070af4', '8bb134f5-64e1-4e67-a604-72eb7db4ba11', '0c6d17e0-405b-430f-a61d-f257a6143856', 'af3b79a4-a16f-43eb-9694-68e76bb287d6'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:15 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:15 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:15 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8a6aebfd-a621-4517-89e5-4dd9a9179153" returned: 0 in 1.001s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-quobyte-8a6aebfd-a621-4517-89e5-4dd9a9179153" released by "delete_volume" :: held 2.393s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:15 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5497fc80-623d-4d3e-a43e-7c6c516125c0" returned: 0 in 0.975s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-5497fc80-623d-4d3e-a43e-7c6c516125c0" released by "delete_volume" :: held 2.500s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Created reservations ['2c0fc83e-8505-424f-a837-396272937ff2', '7ed0dde7-3ea9-4982-89d1-bfae67465ad5', '1845c2ac-b90e-4f11-9a6b-7b13f6050ac5', 'c4cbdc8a-4eaa-4ca9-a86b-1c12a59b6fde'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Created reservations ['98600308-62b2-4f45-8a30-7524507f9d6a', 'a6082b41-fb1a-4a07-8f48-daa7493c9a52', '5831e5cb-b3b6-40de-a0b7-22a6863021ae', '6f6d498d-3511-449d-89fc-6ab00833fef6'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:15 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:15 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:16 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:16 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:16 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.911s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Deleted volume successfully. Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e467d36f-fc44-4e95-885e-b2a7731c0cc3 tempest-VolumesListAdminTestJSON-1863298446 None] Lock "cinder-19a87208-473c-44fe-bd53-21de4421bc72-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-a0a24300-3380-4b0b-9d5b-6af9917da1fc-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "cinder-4f9d6818-8eed-46f8-ab72-befba0d01a5d-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-a0a24300-3380-4b0b-9d5b-6af9917da1fc-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-4f9d6818-8eed-46f8-ab72-befba0d01a5d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-quobyte-a0a24300-3380-4b0b-9d5b-6af9917da1fc" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "cinder-quobyte-4f9d6818-8eed-46f8-ab72-befba0d01a5d" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-a0a24300-3380-4b0b-9d5b-6af9917da1fc" acquired by "delete_volume" :: waited 0.037s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d227d6e-ae97-4391-8965-c3bccfcd430d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-quobyte-4f9d6818-8eed-46f8-ab72-befba0d01a5d" acquired by "delete_volume" :: waited 0.083s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e089db40-5e69-4871-aa2c-5c148a200e0c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:16 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc Jul 06 10:18:16 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:16 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.052s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Deleted volume successfully. Jul 06 10:18:16 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d Jul 06 10:18:16 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:16 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34354bb8-0f81-42b9-b873-3f085a452378 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-8a6aebfd-a621-4517-89e5-4dd9a9179153-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.004s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:16 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Deleted volume successfully. Jul 06 10:18:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e0663bac-2185-4ee8-baa9-ab35c4fe1c5d tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-5497fc80-623d-4d3e-a43e-7c6c516125c0-delete_volume" released by "delete_volume" :: held 4.018s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:17 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc" returned: 0 in 1.045s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:17 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc Jul 06 10:18:17 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:17 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d" returned: 0 in 1.055s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:17 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d Jul 06 10:18:17 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:18 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a0a24300-3380-4b0b-9d5b-6af9917da1fc" returned: 0 in 0.692s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-a0a24300-3380-4b0b-9d5b-6af9917da1fc" released by "delete_volume" :: held 1.806s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Created reservations ['01dae505-43fa-4cb0-843c-e7dc8b02beed', '32755dd3-0596-44b7-969d-eba7b2870206', '512e3d43-030b-42dc-8261-b942ca1a1813', 'cef3a953-af52-4d5b-98ff-68bb491d2804'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:18 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4f9d6818-8eed-46f8-ab72-befba0d01a5d" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-quobyte-4f9d6818-8eed-46f8-ab72-befba0d01a5d" released by "delete_volume" :: held 1.902s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:18 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:18 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Created reservations ['57e9d51b-8ac5-4065-9c94-e617a4a60373', '2ae549cf-ad37-481f-ac0d-c7b9e76e3397', '29eff82e-1bc8-47c6-a28b-d4ccecc4f2d5', '01fb2ffa-d4ae-4357-ac61-3d4db42eed35'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-061b8b7c-8d47-429f-8a92-0b66cebc38f5-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-061b8b7c-8d47-429f-8a92-0b66cebc38f5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "cinder-quobyte-061b8b7c-8d47-429f-8a92-0b66cebc38f5" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-061b8b7c-8d47-429f-8a92-0b66cebc38f5" acquired by "delete_volume" :: waited 0.039s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:18 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:18 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c4cdd3-e355-47dc-bf62-ad2bc81f933a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:19 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 Jul 06 10:18:19 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:19 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.805s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:19 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Deleted volume successfully. Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d01e32af-e512-4da1-bd2b-d34c355b4533 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-a0a24300-3380-4b0b-9d5b-6af9917da1fc-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:19 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.707s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:19 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Deleted volume successfully. Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-72f8956c-b467-407d-aab6-9d1aa3d172a9 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-4f9d6818-8eed-46f8-ab72-befba0d01a5d-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:19 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5" returned: 0 in 0.949s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:19 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5 Jul 06 10:18:19 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "cinder-525ef378-cd2c-4c93-9f09-36085b129eb5-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-525ef378-cd2c-4c93-9f09-36085b129eb5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "cinder-quobyte-525ef378-cd2c-4c93-9f09-36085b129eb5" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-quobyte-525ef378-cd2c-4c93-9f09-36085b129eb5" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a3bea-bd26-4532-b9cb-752cc42084e8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:20 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 Jul 06 10:18:20 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:20 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-061b8b7c-8d47-429f-8a92-0b66cebc38f5" returned: 0 in 0.963s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-quobyte-061b8b7c-8d47-429f-8a92-0b66cebc38f5" released by "delete_volume" :: held 1.966s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:20 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Created reservations ['ce5dcd8e-b827-40b9-99c9-b8b48159727c', 'db034ab2-2d5a-4023-86fb-337d5d50bcf3', 'b8bd0477-63c3-420e-b2d8-d0e6177e95d5', '3e67eed9-9b59-44bb-8595-7c3153a4f1a4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:21 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:21 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:21 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5" returned: 0 in 0.874s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:21 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5 Jul 06 10:18:21 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:21 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.797s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Deleted volume successfully. Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-11abc46a-9c56-4a95-a07c-a486936b7d85 tempest-CreateVolumesFromImageTest-305868580 None] Lock "cinder-061b8b7c-8d47-429f-8a92-0b66cebc38f5-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:21 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-525ef378-cd2c-4c93-9f09-36085b129eb5" returned: 0 in 0.853s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-quobyte-525ef378-cd2c-4c93-9f09-36085b129eb5" released by "delete_volume" :: held 1.794s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:22 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Created reservations ['b5703a10-8319-45a2-893a-93fb78e1b681', 'f8a44020-f547-4ba7-bbdf-55e4618e0819', 'ad1e485b-a220-468a-bb6e-a3473630ed6b', '350a6d69-dd3e-478f-a833-6c4c471736b0'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:22 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:22 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:23 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.104s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:23 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Deleted volume successfully. Jul 06 10:18:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-67b9ca25-5345-40c1-b3b0-6af6fcb1ac03 tempest-VolumesListAdminTestJSON-2079656350 None] Lock "cinder-525ef378-cd2c-4c93-9f09-36085b129eb5-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (c6c9b846-f777-4c64-88c7-56cdcbe467f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1dc348e-5b54-4cde-ada6-72f47ac31fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1dc348e-5b54-4cde-ada6-72f47ac31fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691554338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a33a0e-3835-439b-b28b-08b952abfb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:25Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee71863-8b79-423e-b6a6-d0d0c975134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee71863-8b79-423e-b6a6-d0d0c975134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cc8017-1806-4f47-b924-d76f945f2e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cc8017-1806-4f47-b924-d76f945f2e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a33a0e-3835-439b-b28b-08b952abfb0d', 'volume_name': 'volume-63a33a0e-3835-439b-b28b-08b952abfb0d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a1f3fe-9e4e-40d7-a469-416549133d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a1f3fe-9e4e-40d7-a469-416549133d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcad3dd-d717-4d78-a4d2-f841b661c8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Volume 63a33a0e-3835-439b-b28b-08b952abfb0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a33a0e-3835-439b-b28b-08b952abfb0d', 'volume_size': 1} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691554338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a33a0e-3835-439b-b28b-08b952abfb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:25Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Creating volume 63a33a0e-3835-439b-b28b-08b952abfb0d {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:25 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:25 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d 1073741824 Jul 06 10:18:25 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (6ee99180-4d41-4b48-8066-ee824ebb7c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f8dab1-7326-416f-af6e-5b35261f9428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f8dab1-7326-416f-af6e-5b35261f9428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405241002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a8c5b-78c1-469f-9641-ca13fd890167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:26Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9da6cf-7eaf-4c8c-999c-c2fbe723f734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9da6cf-7eaf-4c8c-999c-c2fbe723f734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42ddaa5-21ca-4768-b037-57a7454776d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42ddaa5-21ca-4768-b037-57a7454776d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090a8c5b-78c1-469f-9641-ca13fd890167', 'volume_name': 'volume-090a8c5b-78c1-469f-9641-ca13fd890167', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b971ecf-9fca-4c57-8c6f-75cfbd5f1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b971ecf-9fca-4c57-8c6f-75cfbd5f1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7a8027-7c58-4964-9ed9-c4e19801ec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume 090a8c5b-78c1-469f-9641-ca13fd890167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090a8c5b-78c1-469f-9641-ca13fd890167', 'volume_size': 1} Jul 06 10:18:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:26 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d 1073741824" returned: 0 in 1.012s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:26 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d Jul 06 10:18:26 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:27 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d" returned: 0 in 0.763s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405241002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a8c5b-78c1-469f-9641-ca13fd890167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:26Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Creating volume 090a8c5b-78c1-469f-9641-ca13fd890167 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:27 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcad3dd-d717-4d78-a4d2-f841b661c8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a33a0e-3835-439b-b28b-08b952abfb0d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:27 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 1073741824 Jul 06 10:18:27 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953984d0-8aef-49f0-a391-25f698c20f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:27 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Volume volume-63a33a0e-3835-439b-b28b-08b952abfb0d (63a33a0e-3835-439b-b28b-08b952abfb0d): created successfully Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953984d0-8aef-49f0-a391-25f698c20f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (c6c9b846-f777-4c64-88c7-56cdcbe467f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:27 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6a57cd43-2b08-4447-b7d7-c25cbdb701e3 tempest-VolumesActionsTest-1831620519 None] Created volume successfully. Jul 06 10:18:28 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 1073741824" returned: 0 in 0.917s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:28 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 Jul 06 10:18:28 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3bc4545-ab67-4c10-b005-c8ec3659e809 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d" by "attach_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3bc4545-ab67-4c10-b005-c8ec3659e809 tempest-VolumesActionsTest-1831620519 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d" acquired by "attach_volume" :: waited 0.034s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b3bc4545-ab67-4c10-b005-c8ec3659e809 tempest-VolumesActionsTest-1831620519 None] Attaching volume 63a33a0e-3835-439b-b28b-08b952abfb0d to instance fe9519bf-8861-45c0-9513-aee2ad22f2bb at mountpoint /dev/vdb on host None. Jul 06 10:18:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b3bc4545-ab67-4c10-b005-c8ec3659e809 tempest-VolumesActionsTest-1831620519 None] Attach volume completed successfully. Jul 06 10:18:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3bc4545-ab67-4c10-b005-c8ec3659e809 tempest-VolumesActionsTest-1831620519 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d" released by "attach_volume" :: held 0.167s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:29 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167" returned: 0 in 0.811s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7a8027-7c58-4964-9ed9-c4e19801ec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090a8c5b-78c1-469f-9641-ca13fd890167', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12c5ab8-d505-4088-8f98-7100e55e4808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume volume-090a8c5b-78c1-469f-9641-ca13fd890167 (090a8c5b-78c1-469f-9641-ca13fd890167): created successfully Jul 06 10:18:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d12c5ab8-d505-4088-8f98-7100e55e4808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (6ee99180-4d41-4b48-8066-ee824ebb7c06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f1fafbf8-8c31-4e78-82dc-b259831d3725 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created volume successfully. Jul 06 10:18:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2094b280-3edc-48c2-9260-33ee83125ec5 tempest-VolumesActionsTest-1177835179 None] Terminate volume connection completed successfully. Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=100,cinder:INSERT=43,cinder:UPDATE=149,cinder:DELETE=16 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2094b280-3edc-48c2-9260-33ee83125ec5 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-detach_volume" by "detach_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=104,cinder:INSERT=34,cinder:UPDATE=140,cinder:DELETE=9 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (547d3b73-f740-465f-ac93-75ebc9b2cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83464183-bdc8-460d-9298-72385b634f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83464183-bdc8-460d-9298-72385b634f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344988586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac55b15-5e25-448b-bea4-995c21fc1dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:30Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e830bec8-c035-4a8f-a706-a72bb3a516d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e830bec8-c035-4a8f-a706-a72bb3a516d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b24b6d-bda3-479e-b2df-cbf87e3089b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b24b6d-bda3-479e-b2df-cbf87e3089b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac55b15-5e25-448b-bea4-995c21fc1dbd', 'volume_name': 'volume-fac55b15-5e25-448b-bea4-995c21fc1dbd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d59c1d6-837a-4695-9fe3-e0a4ee1e19b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d59c1d6-837a-4695-9fe3-e0a4ee1e19b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9d0738-e6bd-4008-9514-1986d4a8d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:30 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume fac55b15-5e25-448b-bea4-995c21fc1dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac55b15-5e25-448b-bea4-995c21fc1dbd', 'volume_size': 1} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1344988586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac55b15-5e25-448b-bea4-995c21fc1dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:30Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Creating volume fac55b15-5e25-448b-bea4-995c21fc1dbd {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:30 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2094b280-3edc-48c2-9260-33ee83125ec5 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-detach_volume" acquired by "detach_volume" :: waited 0.173s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2094b280-3edc-48c2-9260-33ee83125ec5 tempest-VolumesActionsTest-1177835179 None] Detaching volume 63a33a0e-3835-439b-b28b-08b952abfb0d from instance fe9519bf-8861-45c0-9513-aee2ad22f2bb. Jul 06 10:18:30 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd 1073741824 Jul 06 10:18:30 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2094b280-3edc-48c2-9260-33ee83125ec5 tempest-VolumesActionsTest-1177835179 None] Detach volume completed successfully. Jul 06 10:18:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2094b280-3edc-48c2-9260-33ee83125ec5 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (547c40a6-77cf-4c6d-9f72-ecd525c64a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0f6bef-bdaa-4394-9fb4-09de691ce836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d93972a8-24be-4caa-931b-fa59e73c4b46 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-detach_volume" by "detach_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0f6bef-bdaa-4394-9fb4-09de691ce836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816892252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a94a5e-a07b-4d09-b598-1339415e940e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:31Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb73b98-922c-4c2b-b12c-5d17b309055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb73b98-922c-4c2b-b12c-5d17b309055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceccd79-31a7-4e5f-881f-ff752ea1db40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ceccd79-31a7-4e5f-881f-ff752ea1db40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a94a5e-a07b-4d09-b598-1339415e940e', 'volume_name': 'volume-f8a94a5e-a07b-4d09-b598-1339415e940e', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435814b5-78d4-487e-aa56-3904cc93bd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (435814b5-78d4-487e-aa56-3904cc93bd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7470d9-934c-43e6-80fe-e1c2fd6e0998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:31 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume f8a94a5e-a07b-4d09-b598-1339415e940e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a94a5e-a07b-4d09-b598-1339415e940e', 'volume_size': 1} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d93972a8-24be-4caa-931b-fa59e73c4b46 tempest-VolumesActionsTest-1831620519 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-detach_volume" acquired by "detach_volume" :: waited 0.141s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d93972a8-24be-4caa-931b-fa59e73c4b46 tempest-VolumesActionsTest-1831620519 None] Volume detach called, but volume not attached. Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d93972a8-24be-4caa-931b-fa59e73c4b46 tempest-VolumesActionsTest-1831620519 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (37d24185-bf3d-446d-bb3f-384ba436d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80db7293-2a9f-409f-90b6-cffb497f0059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80db7293-2a9f-409f-90b6-cffb497f0059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035198571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaceea7-fb7d-4aeb-8b32-8f05d10c88f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:32Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec4f0dd-c4ed-4c60-a2ad-43a7aaa8d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec4f0dd-c4ed-4c60-a2ad-43a7aaa8d438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c6ee79-7817-40c0-afbf-f6ee920ea351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c6ee79-7817-40c0-afbf-f6ee920ea351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaceea7-fb7d-4aeb-8b32-8f05d10c88f9', 'volume_name': 'volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9723c-f138-4bfb-a4b1-7f66de70f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d9723c-f138-4bfb-a4b1-7f66de70f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:32 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c038c48-1526-4705-839e-17fdb04596ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume acaceea7-fb7d-4aeb-8b32-8f05d10c88f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9', 'volume_size': 1} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd 1073741824" returned: 0 in 1.459s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:32 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd Jul 06 10:18:32 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (880b3671-b880-46e7-8344-ba8ad9939a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20652b6-9754-4515-99e4-beb9191adc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20652b6-9754-4515-99e4-beb9191adc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-406843140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079aba15-c2ea-4144-96f9-891b0ba5c4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:33Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ee98f0-a891-4fb0-bd7d-5354cb3f8a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ee98f0-a891-4fb0-bd7d-5354cb3f8a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3580bb-0c2b-4cb0-84b8-c77abd23416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3580bb-0c2b-4cb0-84b8-c77abd23416f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '079aba15-c2ea-4144-96f9-891b0ba5c4df', 'volume_name': 'volume-079aba15-c2ea-4144-96f9-891b0ba5c4df', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7004c6db-a658-4bbf-8b02-c9feaa99949f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7004c6db-a658-4bbf-8b02-c9feaa99949f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f66ebe-e825-4a77-9ec0-2f457b59b764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume 079aba15-c2ea-4144-96f9-891b0ba5c4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-079aba15-c2ea-4144-96f9-891b0ba5c4df', 'volume_size': 1} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Acquiring lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Acquiring lock "cinder-quobyte-63a33a0e-3835-439b-b28b-08b952abfb0d" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Lock "cinder-quobyte-63a33a0e-3835-439b-b28b-08b952abfb0d" acquired by "delete_volume" :: waited 0.050s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Flow 'volume_create_manager' (ad327eed-b8f0-42e3-b0e1-89a116b3d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cf73f8-4132-4a7e-829f-258c708b29a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05ee893-a4a8-49f7-bdd2-3418372c53a8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75cf73f8-4132-4a7e-829f-258c708b29a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-746507754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c97bfb-5d63-42e7-9a00-86bab00fb770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d908d8d968a4099b23e7c66b94132d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:33Z,use_quota=True,user_id='46f52aea18b2447ba066470a885289b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab48a81e-187e-45f8-a215-feb380778af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab48a81e-187e-45f8-a215-feb380778af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a16a4d1-19aa-4a10-8f07-2f407580c248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a16a4d1-19aa-4a10-8f07-2f407580c248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c97bfb-5d63-42e7-9a00-86bab00fb770', 'volume_name': 'volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931c3bac-abe5-40b2-9f9b-025536c588a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931c3bac-abe5-40b2-9f9b-025536c588a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040c4419-0c28-401f-abac-eb39640c4ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Volume e9c97bfb-5d63-42e7-9a00-86bab00fb770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770', 'volume_size': 1} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:33 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d Jul 06 10:18:33 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (8c3f57a3-c297-4260-baf5-fceb39ef16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028e15b5-1917-45de-be83-461f9ba03697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd" returned: 0 in 1.378s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] <== create_volume: return (2898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.901s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816892252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a94a5e-a07b-4d09-b598-1339415e940e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:31Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Creating volume f8a94a5e-a07b-4d09-b598-1339415e940e {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:33 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028e15b5-1917-45de-be83-461f9ba03697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017320026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:33Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977f3435-440a-4086-991e-79829d8e246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977f3435-440a-4086-991e-79829d8e246f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e 1073741824 Jul 06 10:18:33 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b45cd15-6274-471e-a40e-b8a44ee944e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b45cd15-6274-471e-a40e-b8a44ee944e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4', 'volume_name': 'volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f19ec25-a7a8-4f3b-8bd0-1e66c0f50981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f19ec25-a7a8-4f3b-8bd0-1e66c0f50981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baafb0f7-101a-4381-b337-2d8d39ba7a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume 4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4', 'volume_size': 1} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9d0738-e6bd-4008-9514-1986d4a8d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac55b15-5e25-448b-bea4-995c21fc1dbd', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477ffcc6-8b42-42db-8f14-0c5b69cf8e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume volume-fac55b15-5e25-448b-bea4-995c21fc1dbd (fac55b15-5e25-448b-bea4-995c21fc1dbd): created successfully Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477ffcc6-8b42-42db-8f14-0c5b69cf8e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (547d3b73-f740-465f-ac93-75ebc9b2cf41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:33 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2517e7e0-abec-48a8-9959-94f8c0a39747 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created volume successfully. Jul 06 10:18:34 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d" returned: 0 in 0.988s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:34 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d Jul 06 10:18:34 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:34 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e 1073741824" returned: 0 in 0.975s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:34 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e Jul 06 10:18:34 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:35 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-63a33a0e-3835-439b-b28b-08b952abfb0d" returned: 0 in 0.752s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Lock "cinder-quobyte-63a33a0e-3835-439b-b28b-08b952abfb0d" released by "delete_volume" :: held 1.867s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Created reservations ['838d71ee-dc40-411b-8c37-558ec966c55f', '41c861e3-e36c-43c2-a688-93e9768b5549', '28c0e51c-f8b8-434c-a6fd-d2148f1f37a7', 'a34b0ec8-70f7-456c-901e-cf1abc372c03'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:35 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:35 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:35 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e" returned: 0 in 0.693s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.172s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2035198571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaceea7-fb7d-4aeb-8b32-8f05d10c88f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:32Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Creating volume acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:35 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7470d9-934c-43e6-80fe-e1c2fd6e0998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a94a5e-a07b-4d09-b598-1339415e940e', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd676d9a-e085-4a5f-a290-52bffe709bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:35 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 1073741824 Jul 06 10:18:35 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:35 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume volume-f8a94a5e-a07b-4d09-b598-1339415e940e (f8a94a5e-a07b-4d09-b598-1339415e940e): created successfully Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd676d9a-e085-4a5f-a290-52bffe709bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (547c40a6-77cf-4c6d-9f72-ecd525c64a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-00929cae-3519-4c60-930f-a22699437b84 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created volume successfully. Jul 06 10:18:36 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.877s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Deleted volume successfully. Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6bc9fef9-3f2c-4db6-8e5c-33b8e742ed2e tempest-VolumesActionsTest-1831620519 None] Lock "cinder-63a33a0e-3835-439b-b28b-08b952abfb0d-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:36 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 1073741824" returned: 0 in 0.956s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:36 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 Jul 06 10:18:36 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:36 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9" returned: 0 in 0.631s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.960s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-406843140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079aba15-c2ea-4144-96f9-891b0ba5c4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:33Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Creating volume 079aba15-c2ea-4144-96f9-891b0ba5c4df {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:36 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:37 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df 1073741824 Jul 06 10:18:37 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c038c48-1526-4705-839e-17fdb04596ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0044174-81b5-4572-9ae0-3c874f618036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 (acaceea7-fb7d-4aeb-8b32-8f05d10c88f9): created successfully Jul 06 10:18:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0044174-81b5-4572-9ae0-3c874f618036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (37d24185-bf3d-446d-bb3f-384ba436d23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-93894959-44e6-4a71-8ee8-500dbbf8a0e6 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created volume successfully. Jul 06 10:18:37 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df 1073741824" returned: 0 in 0.965s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:37 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df Jul 06 10:18:38 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:38 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df" returned: 0 in 0.675s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.266s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-746507754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c97bfb-5d63-42e7-9a00-86bab00fb770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d908d8d968a4099b23e7c66b94132d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:33Z,use_quota=True,user_id='46f52aea18b2447ba066470a885289b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Creating volume e9c97bfb-5d63-42e7-9a00-86bab00fb770 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:38 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:38 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 1073741824 Jul 06 10:18:38 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f66ebe-e825-4a77-9ec0-2f457b59b764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079aba15-c2ea-4144-96f9-891b0ba5c4df', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e53963-afec-4cfd-8609-4eb6ce360d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:38 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume volume-079aba15-c2ea-4144-96f9-891b0ba5c4df (079aba15-c2ea-4144-96f9-891b0ba5c4df): created successfully Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e53963-afec-4cfd-8609-4eb6ce360d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (880b3671-b880-46e7-8344-ba8ad9939a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:38 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-df01d8ba-04f6-4c6f-8f88-d8def9b000a8 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created volume successfully. Jul 06 10:18:39 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 1073741824" returned: 0 in 0.794s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:39 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 Jul 06 10:18:39 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:40 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770" returned: 0 in 0.632s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.450s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017320026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0758e28fd569448ba00ef24494e7079e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:33Z,use_quota=True,user_id='9f4136ae4baa4125b4a6f261c88cc146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Creating volume 4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:40 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:40 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 1073741824 Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040c4419-0c28-401f-abac-eb39640c4ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:40 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78e5553-c34f-478f-8f12-777f72a310a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:40 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Volume volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 (e9c97bfb-5d63-42e7-9a00-86bab00fb770): created successfully Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78e5553-c34f-478f-8f12-777f72a310a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Flow 'volume_create_manager' (ad327eed-b8f0-42e3-b0e1-89a116b3d022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d2574089-3ced-4ce6-9305-182748fe7b05 tempest-AbsoluteLimitsTests-1469798612 None] Created volume successfully. Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Acquiring lock "cinder-e9c97bfb-5d63-42e7-9a00-86bab00fb770-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Lock "cinder-e9c97bfb-5d63-42e7-9a00-86bab00fb770-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Acquiring lock "cinder-quobyte-e9c97bfb-5d63-42e7-9a00-86bab00fb770" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Lock "cinder-quobyte-e9c97bfb-5d63-42e7-9a00-86bab00fb770" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38bf552-b333-4aaf-9f27-0aaa09069134]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:40 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 Jul 06 10:18:40 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:41 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 1073741824" returned: 0 in 0.871s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:41 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 Jul 06 10:18:41 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:41 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770" returned: 0 in 0.774s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:41 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770 Jul 06 10:18:41 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:41 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4" returned: 0 in 0.769s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baafb0f7-101a-4381-b337-2d8d39ba7a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbde460-b74b-4877-88e7-6284dfd2137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:41 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Volume volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 (4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4): created successfully Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbde460-b74b-4877-88e7-6284dfd2137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:41 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Flow 'volume_create_manager' (8c3f57a3-c297-4260-baf5-fceb39ef16c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-af01f175-0a67-488b-b67a-5aeade538f74 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created volume successfully. Jul 06 10:18:42 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e9c97bfb-5d63-42e7-9a00-86bab00fb770" returned: 0 in 0.659s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Lock "cinder-quobyte-e9c97bfb-5d63-42e7-9a00-86bab00fb770" released by "delete_volume" :: held 1.488s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Created reservations ['bce37fa4-0bde-411d-aa33-756730ec8d1d', 'c15184c2-ae99-4210-bc9c-1890edae0897', '69b83a9b-7392-4522-84ca-e3e4d40a48df', '9b8e69f4-9b15-4dd4-9bee-23f0cb03ba40'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:42 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:42 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-quobyte-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd1331-7739-4b47-a7ef-76bf4529e773]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:42 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 Jul 06 10:18:42 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:42 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.661s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:42 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Deleted volume successfully. Jul 06 10:18:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9c67d20e-d2b7-47cb-aaf6-c0b034d5e7ba tempest-AbsoluteLimitsTests-1469798612 None] Lock "cinder-e9c97bfb-5d63-42e7-9a00-86bab00fb770-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:43 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4" returned: 0 in 0.840s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:43 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4 Jul 06 10:18:43 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (3e15cd1c-7dc1-49ed-8ce6-1ff1fac4b804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f4371f-8d09-41f8-abcf-938772318a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f4371f-8d09-41f8-abcf-938772318a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652988454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763501fb-66a9-46ef-8a98-4a4aa5a26bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:43Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5b6a8f-e0ae-4e69-9155-0f41ece906df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5b6a8f-e0ae-4e69-9155-0f41ece906df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c73560-f89b-4dce-85dd-03f890716ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c73560-f89b-4dce-85dd-03f890716ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763501fb-66a9-46ef-8a98-4a4aa5a26bba', 'volume_name': 'volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be9a06f-4ccd-452e-843e-fd09683f0cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be9a06f-4ccd-452e-843e-fd09683f0cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c761a7a-4a09-4c67-8403-4403fdf9af20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:43 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Volume 763501fb-66a9-46ef-8a98-4a4aa5a26bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba', 'volume_size': 1} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652988454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763501fb-66a9-46ef-8a98-4a4aa5a26bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:43Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Creating volume 763501fb-66a9-46ef-8a98-4a4aa5a26bba {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:43 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:43 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba 1073741824 Jul 06 10:18:43 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:43 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4" returned: 0 in 0.767s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4" released by "delete_volume" :: held 1.652s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created reservations ['55eb001a-e8f5-415e-af2c-6fdf7773ba8d', '1dffcc72-2b1a-4ed8-ad41-ef66bf2870a7', 'd6df8e7b-013e-434a-a2c0-42144a9b160b', '60c076d6-4c8e-4157-b3e5-fa08479e5b8c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:44 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:44 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:44 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba 1073741824" returned: 0 in 0.967s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-079aba15-c2ea-4144-96f9-891b0ba5c4df-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-079aba15-c2ea-4144-96f9-891b0ba5c4df-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:44 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba Jul 06 10:18:44 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-quobyte-079aba15-c2ea-4144-96f9-891b0ba5c4df" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-079aba15-c2ea-4144-96f9-891b0ba5c4df" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0048982-5526-42c4-a9e9-39c3740d3ae6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:44 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df Jul 06 10:18:44 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:45 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.846s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Deleted volume successfully. Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4186d4a6-ef12-45c7-8e83-50494b211223 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-4ffc6fcf-c2ea-48ef-9c9c-d8ffe5ad9bc4-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:45 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba" returned: 0 in 0.742s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c761a7a-4a09-4c67-8403-4403fdf9af20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72c775a-c108-4b0e-9db1-56db0b02ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:45 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Volume volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba (763501fb-66a9-46ef-8a98-4a4aa5a26bba): created successfully Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a72c775a-c108-4b0e-9db1-56db0b02ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (3e15cd1c-7dc1-49ed-8ce6-1ff1fac4b804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-459481d6-9171-4847-8138-ec30f68fbc7c tempest-VolumesActionsTest-1831620519 None] Created volume successfully. Jul 06 10:18:45 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df" returned: 0 in 0.876s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:45 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df Jul 06 10:18:45 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:46 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-079aba15-c2ea-4144-96f9-891b0ba5c4df" returned: 0 in 0.690s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-079aba15-c2ea-4144-96f9-891b0ba5c4df" released by "delete_volume" :: held 1.619s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created reservations ['60e65cf3-c5d6-4d91-8525-86069cd0118b', '0bb0ef1c-b1f5-4090-9c71-edffe76a4dd5', 'b35d3c51-5ec2-4838-97ae-6fad681e1856', 'eb3063d6-a549-41fe-ba4e-6fe72c69e698'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:46 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:46 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-763501fb-66a9-46ef-8a98-4a4aa5a26bba-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-763501fb-66a9-46ef-8a98-4a4aa5a26bba-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-quobyte-763501fb-66a9-46ef-8a98-4a4aa5a26bba" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-763501fb-66a9-46ef-8a98-4a4aa5a26bba" acquired by "delete_volume" :: waited 0.033s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dcd2f3-ca1e-4ccb-8cef-f24973b7ccfb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-quobyte-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5694720d-b25e-4c86-8577-961ba61c3507]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:47 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba Jul 06 10:18:47 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:47 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.764s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:47 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 Jul 06 10:18:47 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:47 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Deleted volume successfully. Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cf324d6d-b3b0-4bcc-a6fe-6f42853c43af tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-079aba15-c2ea-4144-96f9-891b0ba5c4df-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:47 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba" returned: 0 in 0.860s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:47 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba Jul 06 10:18:47 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:47 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9" returned: 0 in 0.826s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:47 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9 Jul 06 10:18:47 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:48 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-763501fb-66a9-46ef-8a98-4a4aa5a26bba" returned: 0 in 0.693s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-763501fb-66a9-46ef-8a98-4a4aa5a26bba" released by "delete_volume" :: held 1.605s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Created reservations ['a1f3cbe8-e271-4ff6-bdff-b8a8646705b4', 'e22b3575-0b7b-4a3b-be6d-ebfe4fda4e5c', 'be211d77-0439-4785-993c-4c1e1de3153f', 'b861eeba-8338-4106-bd96-9a80cf605d6a'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:48 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9" returned: 0 in 0.729s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9" released by "delete_volume" :: held 1.613s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created reservations ['6998e38e-1b36-4813-a956-6d28c903d637', '5e710331-904b-47c1-87e1-0fb154d510f8', '24d7beb7-4d28-43a5-b35f-50b95ab8fad9', '709dba93-6831-4787-8928-34fb31fce0eb'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:48 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:48 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:48 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:48 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-f8a94a5e-a07b-4d09-b598-1339415e940e-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-f8a94a5e-a07b-4d09-b598-1339415e940e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Flow 'volume_create_manager' (c6ad84cf-e798-4f8c-ae36-37aa838bf644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe8c829-e927-4b64-8901-1275e6b4cf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe8c829-e927-4b64-8901-1275e6b4cf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1988423631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709e917e-fa7e-4dc8-868d-1f1f9a48e5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac8db1f18ac4e8f8447c34db9c98726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:49Z,use_quota=True,user_id='2bdcad23ce984e7b8b9ed022cf7f1fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cea293-13d0-4598-80c8-fdc83d86f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cea293-13d0-4598-80c8-fdc83d86f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d35b0dc-a9f4-423a-99a4-414588180ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d35b0dc-a9f4-423a-99a4-414588180ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709e917e-fa7e-4dc8-868d-1f1f9a48e5e9', 'volume_name': 'volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579e8765-6565-412a-933f-948b8a42b645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579e8765-6565-412a-933f-948b8a42b645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f56b7c-338f-43f4-8988-be9968a2b748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Volume 709e917e-fa7e-4dc8-868d-1f1f9a48e5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9', 'volume_size': 1} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1988423631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709e917e-fa7e-4dc8-868d-1f1f9a48e5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac8db1f18ac4e8f8447c34db9c98726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:49Z,use_quota=True,user_id='2bdcad23ce984e7b8b9ed022cf7f1fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Creating volume 709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:49 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:49 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 1073741824 Jul 06 10:18:49 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-quobyte-f8a94a5e-a07b-4d09-b598-1339415e940e" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:49 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.799s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Deleted volume successfully. Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-f8a94a5e-a07b-4d09-b598-1339415e940e" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-48376beb-cb65-4315-a029-dd837a4f7691 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-763501fb-66a9-46ef-8a98-4a4aa5a26bba-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aeccc1-2aae-4669-881f-9c94aea2945b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:49 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e Jul 06 10:18:49 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:49 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.979s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Deleted volume successfully. Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5dc6525a-961e-4f3d-8ad5-a117ac5d93f3 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-acaceea7-fb7d-4aeb-8b32-8f05d10c88f9-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (96eaaf01-8624-4f07-b7b8-ab283121b596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4693e11a-41f9-4822-bc36-da5c40a0a22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4693e11a-41f9-4822-bc36-da5c40a0a22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1334845204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:50Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8165c711-8e8f-45b6-a684-419eeb262634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8165c711-8e8f-45b6-a684-419eeb262634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d5a54d-61fd-4675-ba07-1ab9a6b8e855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d5a54d-61fd-4675-ba07-1ab9a6b8e855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23', 'volume_name': 'volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17200be-b6a9-4a5b-99fa-e805b3339424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17200be-b6a9-4a5b-99fa-e805b3339424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2c55f8-aacf-4d14-9e6b-3bef2595fdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:49 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Volume 0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23', 'volume_size': 1} Jul 06 10:18:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:50 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e" returned: 0 in 0.838s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:50 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e Jul 06 10:18:50 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:50 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 1073741824" returned: 0 in 1.007s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:50 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 Jul 06 10:18:50 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:51 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-f8a94a5e-a07b-4d09-b598-1339415e940e" returned: 0 in 0.691s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-f8a94a5e-a07b-4d09-b598-1339415e940e" released by "delete_volume" :: held 1.598s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:51 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9" returned: 0 in 0.653s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1334845204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:50Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Creating volume 0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:51 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f56b7c-338f-43f4-8988-be9968a2b748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:51 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 1073741824 Jul 06 10:18:51 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1f4917-da31-4415-9f48-10048c456feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:51 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Volume volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 (709e917e-fa7e-4dc8-868d-1f1f9a48e5e9): created successfully Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1f4917-da31-4415-9f48-10048c456feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Flow 'volume_create_manager' (c6ad84cf-e798-4f8c-ae36-37aa838bf644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-94eb1d0a-ebcb-4e25-a715-1ca3b8add05e tempest-VolumesTransfersTest-524201931 None] Created volume successfully. Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created reservations ['003cbc2e-cd97-4d43-9594-1f2236b76169', 'db634fdd-f9d0-4d5e-862c-cf5b108a23af', 'ecad316c-39cc-4a15-afb9-2f32809622c7', '8f9c6160-f30a-4142-8f64-af6b55723c28'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:51 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:51 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-fac55b15-5e25-448b-bea4-995c21fc1dbd-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-fac55b15-5e25-448b-bea4-995c21fc1dbd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-quobyte-fac55b15-5e25-448b-bea4-995c21fc1dbd" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-fac55b15-5e25-448b-bea4-995c21fc1dbd" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2becb9c-a8f2-4e3e-a8ba-aba16cf67a84]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:51 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd Jul 06 10:18:51 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:52 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:52 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 1073741824" returned: 0 in 1.019s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cd2d5b34-20eb-4236-953e-a58b90cf69ae tempest-VolumesTransfersTest-297844101 None] Transfer volume completed successfully. Jul 06 10:18:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Deleted volume successfully. Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7db073fb-acf0-4cf6-9a0d-8a58e6fd6bc5 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-f8a94a5e-a07b-4d09-b598-1339415e940e-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:52 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 Jul 06 10:18:52 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:52 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd" returned: 0 in 0.865s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:52 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd Jul 06 10:18:52 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:52 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23" returned: 0 in 0.681s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2c55f8-aacf-4d14-9e6b-3bef2595fdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325ad88f-6480-4b05-823e-7eb742d73567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Volume volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 (0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23): created successfully Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325ad88f-6480-4b05-823e-7eb742d73567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (96eaaf01-8624-4f07-b7b8-ab283121b596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-80fbb59f-1d8d-4ce5-89fa-2835a9b2af03 tempest-VolumesActionsTest-1831620519 None] Created volume successfully. Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Acquiring lock "cinder-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Acquiring lock "cinder-quobyte-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-quobyte-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9" acquired by "delete_volume" :: waited 0.013s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0d429-d616-4c3c-bb43-295c83a966e9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:53 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fac55b15-5e25-448b-bea4-995c21fc1dbd" returned: 0 in 0.734s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-fac55b15-5e25-448b-bea4-995c21fc1dbd" released by "delete_volume" :: held 1.646s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created reservations ['757a8e87-e99c-4ecc-9bed-7ef0f3f46204', 'b77fe45b-210c-46a6-bb82-5e24d9b1162b', '71a78fc6-c2ff-497b-892a-bfa29edfbb47', 'b957adc7-499f-4e9b-a6f5-2e69081f1fd7'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:53 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 Jul 06 10:18:53 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:53 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:53 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-090a8c5b-78c1-469f-9641-ca13fd890167-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-090a8c5b-78c1-469f-9641-ca13fd890167-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "cinder-quobyte-090a8c5b-78c1-469f-9641-ca13fd890167" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-090a8c5b-78c1-469f-9641-ca13fd890167" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[95deb7d6-ae88-4484-9195-1c1cd705a027]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:54 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 Jul 06 10:18:54 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:54 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9" returned: 0 in 0.839s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:54 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9 Jul 06 10:18:54 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:54 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.714s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:54 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Deleted volume successfully. Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d4164e9-de11-4aa4-a601-c27ac9dc2622 tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-fac55b15-5e25-448b-bea4-995c21fc1dbd-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-quobyte-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[26609afc-5737-4f01-8a3e-31def50f94a9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:54 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 Jul 06 10:18:54 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:54 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167" returned: 0 in 0.840s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:54 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167 Jul 06 10:18:54 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:54 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9" returned: 0 in 0.680s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-quobyte-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9" released by "delete_volume" :: held 1.564s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Created reservations ['dce9e1d6-85b3-46b1-a010-8d25b035559b', '6906b8cb-3d08-4987-927e-134d6073aaa2', '244074ca-dfc0-4872-8f48-4e1bed8d548a', '777d2079-9453-4203-94e6-d4665c4a3dac'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:54 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:54 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:55 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23" returned: 0 in 0.795s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:55 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23 Jul 06 10:18:55 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:55 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-090a8c5b-78c1-469f-9641-ca13fd890167" returned: 0 in 0.650s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-quobyte-090a8c5b-78c1-469f-9641-ca13fd890167" released by "delete_volume" :: held 1.539s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Created reservations ['710ff7ef-b822-4ccc-afb1-8f3da022f394', 'e50edb52-e7e3-4be2-a99b-398ce7ce61be', 'bc0f0737-1c84-4de0-b31a-a1f2f8f79f17', '01f25e02-189c-436c-be99-a17bb1ed1720'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:55 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.693s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Deleted volume successfully. Jul 06 10:18:55 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:55 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b89b2914-3702-4de7-8f73-d4af04c6d868 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-709e917e-fa7e-4dc8-868d-1f1f9a48e5e9-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:55 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23" released by "delete_volume" :: held 1.525s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:55 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Created reservations ['1bdb871d-e080-4c12-8703-a473b6156fe3', '5b5bb71e-6a59-4e71-9d83-415aa9888cce', '73bea0b9-003b-4bde-bc54-31c63fb7c60b', 'fcfad76e-6722-4c36-b14d-1cda19d7c4f5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:56 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:56 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Flow 'volume_create_manager' (e6fef4b4-01ab-433e-a610-ffc9010f729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de12603-7043-46bd-a366-15b3547086c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de12603-7043-46bd-a366-15b3547086c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1167994657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6182905f-6653-41ab-b1a4-418de68db78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac8db1f18ac4e8f8447c34db9c98726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:56Z,use_quota=True,user_id='2bdcad23ce984e7b8b9ed022cf7f1fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb926e0-a41e-4b86-a361-b264fbf6d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb926e0-a41e-4b86-a361-b264fbf6d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5826c1-f3db-4147-b9d2-b6ca51eb15e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5826c1-f3db-4147-b9d2-b6ca51eb15e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6182905f-6653-41ab-b1a4-418de68db78f', 'volume_name': 'volume-6182905f-6653-41ab-b1a4-418de68db78f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afabb2f-e067-4d87-b727-796265a1c76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4afabb2f-e067-4d87-b727-796265a1c76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7825f181-5012-43cb-a92d-1e75c7555cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Volume 6182905f-6653-41ab-b1a4-418de68db78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6182905f-6653-41ab-b1a4-418de68db78f', 'volume_size': 1} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1167994657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6182905f-6653-41ab-b1a4-418de68db78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac8db1f18ac4e8f8447c34db9c98726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:56Z,use_quota=True,user_id='2bdcad23ce984e7b8b9ed022cf7f1fc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Creating volume 6182905f-6653-41ab-b1a4-418de68db78f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:56 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:56 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f 1073741824 Jul 06 10:18:56 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:56 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.745s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Deleted volume successfully. Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-34898299-6714-4b29-878d-fcd355337a6c tempest-CreateVolumesFromSourceVolumeTest-1580048603 None] Lock "cinder-090a8c5b-78c1-469f-9641-ca13fd890167-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:56 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.787s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Deleted volume successfully. Jul 06 10:18:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-86c301df-bf9a-454a-aa27-9f0cb3cf3eb5 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-0bd34d3b-5e5b-4044-a8dd-e34b67a6fe23-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (ee3303cb-954e-411e-82a6-51bff430f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada2313-a215-4221-8946-155296451bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ada2313-a215-4221-8946-155296451bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002198016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280cfd26-51be-4e0e-8cd2-0397eb4da21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:57Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:57 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173cd6fd-d76f-43fe-9c29-4769dee9ce69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173cd6fd-d76f-43fe-9c29-4769dee9ce69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a88dd2-21dd-4bcd-a03c-9fdb251b23c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a88dd2-21dd-4bcd-a03c-9fdb251b23c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280cfd26-51be-4e0e-8cd2-0397eb4da21d', 'volume_name': 'volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a499483-7f17-4c86-9648-cce7b635b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a499483-7f17-4c86-9648-cce7b635b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba82a2c7-27f6-4461-b3f6-d70a386f5900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:57 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Volume 280cfd26-51be-4e0e-8cd2-0397eb4da21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d', 'volume_size': 1} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f 1073741824" returned: 0 in 1.149s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:57 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f Jul 06 10:18:57 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:58 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f" returned: 0 in 0.699s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.738s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002198016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280cfd26-51be-4e0e-8cd2-0397eb4da21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:18:57Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Creating volume 280cfd26-51be-4e0e-8cd2-0397eb4da21d {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:18:58 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:58 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d 1073741824 Jul 06 10:18:58 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7825f181-5012-43cb-a92d-1e75c7555cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6182905f-6653-41ab-b1a4-418de68db78f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ee019c-efb6-4a41-a09d-860e9120d3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Volume volume-6182905f-6653-41ab-b1a4-418de68db78f (6182905f-6653-41ab-b1a4-418de68db78f): created successfully Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ee019c-efb6-4a41-a09d-860e9120d3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Flow 'volume_create_manager' (e6fef4b4-01ab-433e-a610-ffc9010f729e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a7de12e6-c3fa-4f60-8184-35df6de9bf86 tempest-VolumesTransfersTest-524201931 None] Created volume successfully. Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:58 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d 1073741824" returned: 0 in 0.868s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:58 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:18:58 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:59 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d Jul 06 10:18:59 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Acquiring lock "cinder-6182905f-6653-41ab-b1a4-418de68db78f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-6182905f-6653-41ab-b1a4-418de68db78f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:59 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.802s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Acquiring lock "cinder-quobyte-6182905f-6653-41ab-b1a4-418de68db78f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:18:59 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d" returned: 0 in 0.781s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-quobyte-6182905f-6653-41ab-b1a4-418de68db78f" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba82a2c7-27f6-4461-b3f6-d70a386f5900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03f8d2-68b6-4011-807e-ebaa5d6c419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b67431-7388-41f0-b08a-7466960082e0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:18:59 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Volume volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d (280cfd26-51be-4e0e-8cd2-0397eb4da21d): created successfully Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed03f8d2-68b6-4011-807e-ebaa5d6c419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:18:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (ee3303cb-954e-411e-82a6-51bff430f882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:18:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fa08d6e6-38fe-495f-9002-8acaf77182ae tempest-VolumesActionsTest-1831620519 None] Created volume successfully. Jul 06 10:18:59 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f Jul 06 10:18:59 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:00 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f" returned: 0 in 0.775s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:00 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f Jul 06 10:19:00 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-280cfd26-51be-4e0e-8cd2-0397eb4da21d-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-280cfd26-51be-4e0e-8cd2-0397eb4da21d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-quobyte-280cfd26-51be-4e0e-8cd2-0397eb4da21d" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-280cfd26-51be-4e0e-8cd2-0397eb4da21d" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c84cab-facc-46f6-ad18-47c90084e164]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:00 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d Jul 06 10:19:00 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:01 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-6182905f-6653-41ab-b1a4-418de68db78f" returned: 0 in 0.674s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-quobyte-6182905f-6653-41ab-b1a4-418de68db78f" released by "delete_volume" :: held 1.505s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Created reservations ['667948d3-fd93-4282-a301-9d3f49f93d03', '528bafcb-7a85-4877-8662-d742d7412a82', '268b9950-95d4-4c05-b2de-642b3462fba0', 'cd909681-91a2-400d-8f79-530c00fc1e04'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:01 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:01 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:01 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d" returned: 0 in 0.826s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:01 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d Jul 06 10:19:01 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Flow 'volume_create_manager' (cc980498-69e1-4d43-919a-9aa91ca0bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9869cbb8-fb55-4e29-acc4-2afac4fff8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9869cbb8-fb55-4e29-acc4-2afac4fff8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cacca8f-a4d0-40dc-ab40-81527a0e0caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56291840a6e246119c3061f36b5e5c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:02Z,use_quota=True,user_id='473cebb1667745328f6a3b35707af35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14bdcf1-1dcd-46a5-b48e-f107b6c405e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14bdcf1-1dcd-46a5-b48e-f107b6c405e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc00b726-51ca-4629-892c-82c4ffc76665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:19:02 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.700s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Deleted volume successfully. Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b33a8393-5c0f-434f-b982-1ca8378f56e3 tempest-VolumesTransfersTest-1228756498 None] Lock "cinder-6182905f-6653-41ab-b1a4-418de68db78f-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:02 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-280cfd26-51be-4e0e-8cd2-0397eb4da21d" returned: 0 in 0.749s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-280cfd26-51be-4e0e-8cd2-0397eb4da21d" released by "delete_volume" :: held 1.621s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Created reservations ['027586b7-2048-45bb-91c5-35f93a1dd452', 'dc2f9314-6433-4060-b096-52a228ff419b', '3b8358c4-1e33-43b6-8f52-0baf44135095', 'c04198d2-d545-41a0-ac0e-214aa24bbda5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc00b726-51ca-4629-892c-82c4ffc76665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4cacca8f-a4d0-40dc-ab40-81527a0e0caa', 'volume_name': 'volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa', 'volume_size': 1, 'image_id': '05788ebf-6ca9-43d2-97b3-94f971482c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05788ebf-6ca9-43d2-97b3-94f971482c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28b23cfc6237808f50712f0b1a64dd06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56291840a6e246119c3061f36b5e5c3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3fe51c38961998ea2d04641ac9d460a6b13f618f677aeee1a266383522ff60d1752121b302a1efa252abaa111a1aa1a601ddfae3453a66de64894c2157fa46c2', 'id': '05788ebf-6ca9-43d2-97b3-94f971482c32', 'created_at': datetime.datetime(2026, 7, 6, 8, 18, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 19, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05788ebf-6ca9-43d2-97b3-94f971482c32/file', 'properties': {}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0049f6ba-d6ed-4f8c-84f7-a0f25ccf4955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0049f6ba-d6ed-4f8c-84f7-a0f25ccf4955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4236fed-00ff-4ba4-beec-f5f89d30e9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:02 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Volume 4cacca8f-a4d0-40dc-ab40-81527a0e0caa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa', 'volume_size': 1, 'image_id': '05788ebf-6ca9-43d2-97b3-94f971482c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05788ebf-6ca9-43d2-97b3-94f971482c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28b23cfc6237808f50712f0b1a64dd06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56291840a6e246119c3061f36b5e5c3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3fe51c38961998ea2d04641ac9d460a6b13f618f677aeee1a266383522ff60d1752121b302a1efa252abaa111a1aa1a601ddfae3453a66de64894c2157fa46c2', 'id': '05788ebf-6ca9-43d2-97b3-94f971482c32', 'created_at': datetime.datetime(2026, 7, 6, 8, 18, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 19, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05788ebf-6ca9-43d2-97b3-94f971482c32/file', 'properties': {}}, 'image_service': } Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Trying to clone 4cacca8f-a4d0-40dc-ab40-81527a0e0caa from image 05788ebf-6ca9-43d2-97b3-94f971482c32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/05788ebf-6ca9-43d2-97b3-94f971482c32', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:02 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:02 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:19:02 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Image download 0.00 MB at 0.00 MB/s Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e2c98b-8a3c-4971-81ba-21f234302e7e]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:02 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD Jul 06 10:19:02 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:03 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.750s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Deleted volume successfully. Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9045bbcc-c12d-4ddc-9fa5-4d8cfc91fa53 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-280cfd26-51be-4e0e-8cd2-0397eb4da21d-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:03 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:03 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD Jul 06 10:19:03 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (f6c92c55-3f10-4bc8-b38d-fc5f65a2171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794fdf6a-43d6-4147-9fb7-14ea510255d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794fdf6a-43d6-4147-9fb7-14ea510255d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010480349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2ba5fe-1afc-4016-b5a7-671cf3d631a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:04Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274080ab-ec23-4bea-b6d0-3962de257009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (274080ab-ec23-4bea-b6d0-3962de257009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7702b28a-cc7f-4249-a972-d49065543383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7702b28a-cc7f-4249-a972-d49065543383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2ba5fe-1afc-4016-b5a7-671cf3d631a4', 'volume_name': 'volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2a2ff9-f217-4441-9dda-1144376fe8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2a2ff9-f217-4441-9dda-1144376fe8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebe26f1-336e-4a73-b7bb-f99568acd30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Volume 3d2ba5fe-1afc-4016-b5a7-671cf3d631a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4', 'volume_size': 1} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2010480349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2ba5fe-1afc-4016-b5a7-671cf3d631a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:04Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Creating volume 3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:03 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:03 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 1073741824 Jul 06 10:19:03 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:04 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD" returned: 1 in 0.860s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:19:04 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Temporary image 05788ebf-6ca9-43d2-97b3-94f971482c32 is fetched for user 473cebb1667745328f6a3b35707af35d. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:19:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dab8000-0a22-48c6-a071-dcc1764f69dc]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:04 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD Jul 06 10:19:04 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:04 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 1073741824" returned: 0 in 0.989s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:04 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 Jul 06 10:19:04 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:05 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:05 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD Jul 06 10:19:05 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:05 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4" returned: 0 in 0.705s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cebe26f1-336e-4a73-b7bb-f99568acd30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678e45ca-96dd-4eaa-84ca-5a0462ebc858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Volume volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 (3d2ba5fe-1afc-4016-b5a7-671cf3d631a4): created successfully Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678e45ca-96dd-4eaa-84ca-5a0462ebc858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (f6c92c55-3f10-4bc8-b38d-fc5f65a2171f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-462bf8b9-ab8d-422b-942b-9ad09888a620 tempest-VolumesActionsTest-1831620519 None] Created volume successfully. Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "cinder-quobyte-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:05 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD" returned: 1 in 0.798s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cacca8f-a4d0-40dc-ab40-81527a0e0caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56291840a6e246119c3061f36b5e5c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:02Z,use_quota=True,user_id='473cebb1667745328f6a3b35707af35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Creating volume 4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:06 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b54bf33-db30-4b8f-a0fa-8010039c8f16]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:06 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa 1073741824 Jul 06 10:19:06 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:06 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 Jul 06 10:19:06 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:06 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4" returned: 0 in 0.843s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:06 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4 Jul 06 10:19:06 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:06 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa 1073741824" returned: 0 in 0.943s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:07 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa Jul 06 10:19:07 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:07 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-quobyte-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4" released by "delete_volume" :: held 1.578s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Created reservations ['1a59454a-ba6f-4fbb-bc7e-c824547bc8f2', '6d20530f-7f94-4f12-a081-4a35be1ada47', '472d7a29-f6e7-4acb-95b9-71e41883ed18', 'e35f6e7a-7ee6-49e2-a69f-0e917cae9bb5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:07 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" returned: 0 in 0.664s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Attempting download of 05788ebf-6ca9-43d2-97b3-94f971482c32 ((None, [{'url': 'file:///opt/stack/data/glance/images/05788ebf-6ca9-43d2-97b3-94f971482c32', 'metadata': {}}])) to volume 4cacca8f-a4d0-40dc-ab40-81527a0e0caa. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:07 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:07 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac178d-d4df-4802-870f-db6c12c54a71]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05788ebf-6ca9-43d2-97b3-94f971482c32_34p5iff4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:07 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05788ebf-6ca9-43d2-97b3-94f971482c32_34p5iff4 Jul 06 10:19:07 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:08 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.707s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Deleted volume successfully. Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5be9a6b6-9f64-4a93-93b8-b0d33a93bde0 tempest-VolumesActionsTest-1177835179 None] Lock "cinder-3d2ba5fe-1afc-4016-b5a7-671cf3d631a4-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:08 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_05788ebf-6ca9-43d2-97b3-94f971482c32_34p5iff4" returned: 0 in 0.829s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05788ebf-6ca9-43d2-97b3-94f971482c32_34p5iff4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:08 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05788ebf-6ca9-43d2-97b3-94f971482c32_34p5iff4 Jul 06 10:19:08 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (026d7ab5-1f38-4fde-b0b4-eba1944b506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4a5232-9cd0-4b24-b385-9ce34fa9ca0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4a5232-9cd0-4b24-b385-9ce34fa9ca0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1969780421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a9a4cc-f696-4b4c-805d-10c6cbf572ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:09Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e423e654-0e1e-48ee-be4c-6558d88871ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e423e654-0e1e-48ee-be4c-6558d88871ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c70be-c5f7-4af3-aa3c-f1d98ecd17c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857c70be-c5f7-4af3-aa3c-f1d98ecd17c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a9a4cc-f696-4b4c-805d-10c6cbf572ca', 'volume_name': 'volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12902b5b-70c3-468f-8421-4259bb7763b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12902b5b-70c3-468f-8421-4259bb7763b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f0fb77-a18a-4187-9746-bb7697d3b5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:08 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Volume 68a9a4cc-f696-4b4c-805d-10c6cbf572ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca', 'volume_size': 1} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1969780421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a9a4cc-f696-4b4c-805d-10c6cbf572ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b018c0ff30a4710b4bf42e130365ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:09Z,use_quota=True,user_id='72b2e1fa885d4b0c9c0e92c24530933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Creating volume 68a9a4cc-f696-4b4c-805d-10c6cbf572ca {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:08 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:08 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca 1073741824 Jul 06 10:19:08 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:09 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05788ebf-6ca9-43d2-97b3-94f971482c32_34p5iff4" returned: 1 in 0.776s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_05788ebf-6ca9-43d2-97b3-94f971482c32_34p5iff4' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e58fd-a947-485a-9958-a951a30e1a08]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:09 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD Jul 06 10:19:09 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:09 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Flow 'volume_create_manager' (9e123bcc-533a-4fa4-b4ec-07186356c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e6957b-c808-4d20-98b4-d1b6127f31f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca 1073741824" returned: 0 in 0.928s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e6957b-c808-4d20-98b4-d1b6127f31f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-875272415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16542b-773a-40c3-8894-569c94f3b7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6158c14103834a3ba4e45842c4e9a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:10Z,use_quota=True,user_id='23ae1a39a9a3488ab109f680e176674d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f942c5-e103-4da0-910a-a9c2aced08c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f942c5-e103-4da0-910a-a9c2aced08c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5610f710-c8c6-42f9-8378-ac71fef63f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5610f710-c8c6-42f9-8378-ac71fef63f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f16542b-773a-40c3-8894-569c94f3b7b7', 'volume_name': 'volume-0f16542b-773a-40c3-8894-569c94f3b7b7', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e399c046-37ec-4db8-9499-e0dedcfa7009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e399c046-37ec-4db8-9499-e0dedcfa7009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b974c30e-3b00-499a-8134-2eb27e133fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:09 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Volume 0f16542b-773a-40c3-8894-569c94f3b7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f16542b-773a-40c3-8894-569c94f3b7b7', 'volume_size': 1} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:09 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca Jul 06 10:19:09 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:10 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:10 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD Jul 06 10:19:10 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:10 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca" returned: 0 in 0.624s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.653s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-875272415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16542b-773a-40c3-8894-569c94f3b7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6158c14103834a3ba4e45842c4e9a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:10Z,use_quota=True,user_id='23ae1a39a9a3488ab109f680e176674d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Creating volume 0f16542b-773a-40c3-8894-569c94f3b7b7 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:10 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:10 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 1073741824 Jul 06 10:19:10 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f0fb77-a18a-4187-9746-bb7697d3b5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c210eba-5ec2-4c3f-8a4d-5612df9eec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:10 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Volume volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca (68a9a4cc-f696-4b4c-805d-10c6cbf572ca): created successfully Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c210eba-5ec2-4c3f-8a4d-5612df9eec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Flow 'volume_create_manager' (026d7ab5-1f38-4fde-b0b4-eba1944b506f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-565ea656-8b5a-4689-964d-8a1c3c45b9b1 tempest-VolumesActionsTest-1831620519 None] Created volume successfully. Jul 06 10:19:10 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD" returned: 1 in 0.726s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] 05788ebf-6ca9-43d2-97b3-94f971482c32 was raw, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:19:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:10 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa Jul 06 10:19:10 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:11 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 1073741824" returned: 0 in 0.900s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:11 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 Jul 06 10:19:11 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Acquiring lock "cinder-68a9a4cc-f696-4b4c-805d-10c6cbf572ca-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Lock "cinder-68a9a4cc-f696-4b4c-805d-10c6cbf572ca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Acquiring lock "cinder-quobyte-68a9a4cc-f696-4b4c-805d-10c6cbf572ca" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Lock "cinder-quobyte-68a9a4cc-f696-4b4c-805d-10c6cbf572ca" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e673ce32-167d-4893-ad5a-69609c5b95cb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:11 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" returned: 0 in 0.866s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_05788ebf-6ca9-43d2-97b3-94f971482c32_dy0jmnmedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:19:11 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 10:19:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:11 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa 1G Jul 06 10:19:11 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:11 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca Jul 06 10:19:11 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:12 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7" returned: 0 in 0.757s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b974c30e-3b00-499a-8134-2eb27e133fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f16542b-773a-40c3-8894-569c94f3b7b7', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c37f09-8ef0-4511-9087-02fa64028e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:12 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Volume volume-0f16542b-773a-40c3-8894-569c94f3b7b7 (0f16542b-773a-40c3-8894-569c94f3b7b7): created successfully Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c37f09-8ef0-4511-9087-02fa64028e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Flow 'volume_create_manager' (9e123bcc-533a-4fa4-b4ec-07186356c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-db4809a8-5efc-4f78-a2a7-ecc485360099 tempest-VolumesTransfersV355Test-1380927584 None] Created volume successfully. Jul 06 10:19:12 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa 1G" returned: 0 in 0.737s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:12 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca" returned: 0 in 0.788s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1619c-1ce9-4598-9ba4-3257f23d92e4]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:12 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca Jul 06 10:19:12 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:12 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa Jul 06 10:19:12 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:13 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-68a9a4cc-f696-4b4c-805d-10c6cbf572ca" returned: 0 in 0.687s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Lock "cinder-quobyte-68a9a4cc-f696-4b4c-805d-10c6cbf572ca" released by "delete_volume" :: held 1.530s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Created reservations ['21e9aaab-fc8a-484f-aaa8-91ffc3933584', 'e74996c6-a110-4505-b375-876ebc880d8c', 'd4ffe6e6-7a8d-4e2e-9438-da5f379b3984', '45f62d90-6306-441f-a04c-c4e28e3de744'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:13 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" returned: 0 in 0.794s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:13 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:13 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:13 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa Jul 06 10:19:13 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4abbe467-a44f-4523-819d-697465168d73 tempest-VolumesTransfersV355Test-664425347 None] Transfer volume completed successfully. Jul 06 10:19:14 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.675s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:14 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Deleted volume successfully. Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-89fcd3f7-bc6e-4bf0-b220-efd71da583ae tempest-VolumesActionsTest-1831620519 None] Lock "cinder-68a9a4cc-f696-4b4c-805d-10c6cbf572ca-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:14 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" returned: 1 in 0.838s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Downloaded image 05788ebf-6ca9-43d2-97b3-94f971482c32 ((None, [{'url': 'file:///opt/stack/data/glance/images/05788ebf-6ca9-43d2-97b3-94f971482c32', 'metadata': {}}])) to volume 4cacca8f-a4d0-40dc-ab40-81527a0e0caa successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Temporary image 05788ebf-6ca9-43d2-97b3-94f971482c32 for user 473cebb1667745328f6a3b35707af35d is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Marking volume 4cacca8f-a4d0-40dc-ab40-81527a0e0caa as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Copying metadata from image 05788ebf-6ca9-43d2-97b3-94f971482c32 to 4cacca8f-a4d0-40dc-ab40-81527a0e0caa. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Creating volume glance metadata for volume 4cacca8f-a4d0-40dc-ab40-81527a0e0caa backed by image 05788ebf-6ca9-43d2-97b3-94f971482c32 with: {'image_id': '05788ebf-6ca9-43d2-97b3-94f971482c32', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '28b23cfc6237808f50712f0b1a64dd06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4236fed-00ff-4ba4-beec-f5f89d30e9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa', 'volume_size': 1, 'image_id': '05788ebf-6ca9-43d2-97b3-94f971482c32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/05788ebf-6ca9-43d2-97b3-94f971482c32', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28b23cfc6237808f50712f0b1a64dd06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56291840a6e246119c3061f36b5e5c3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3fe51c38961998ea2d04641ac9d460a6b13f618f677aeee1a266383522ff60d1752121b302a1efa252abaa111a1aa1a601ddfae3453a66de64894c2157fa46c2', 'id': '05788ebf-6ca9-43d2-97b3-94f971482c32', 'created_at': datetime.datetime(2026, 7, 6, 8, 18, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 19, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/05788ebf-6ca9-43d2-97b3-94f971482c32/file', 'properties': {}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f780531e-b606-498e-99f2-876fdbd7e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:14 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Volume volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa (4cacca8f-a4d0-40dc-ab40-81527a0e0caa): created successfully Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f780531e-b606-498e-99f2-876fdbd7e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Flow 'volume_create_manager' (cc980498-69e1-4d43-919a-9aa91ca0bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:14 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f15e5cf1-0bbb-4987-a1ef-dda12e1e7393 tempest-VolumeImageDependencyTests-1024162387 None] Created volume successfully. Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Acquiring lock "cinder-0f16542b-773a-40c3-8894-569c94f3b7b7-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-0f16542b-773a-40c3-8894-569c94f3b7b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Acquiring lock "cinder-quobyte-0f16542b-773a-40c3-8894-569c94f3b7b7" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-quobyte-0f16542b-773a-40c3-8894-569c94f3b7b7" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f6dd15-aadc-47ee-b7fe-d1d3f4cc4fef]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:14 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 Jul 06 10:19:14 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Acquiring lock "cinder-4cacca8f-a4d0-40dc-ab40-81527a0e0caa-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Lock "cinder-4cacca8f-a4d0-40dc-ab40-81527a0e0caa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Acquiring lock "cinder-quobyte-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Lock "cinder-quobyte-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:15 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d271082-0c9b-4fac-a2ff-fcef1e8f0960]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:15 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa Jul 06 10:19:15 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:15 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7" returned: 0 in 0.902s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:15 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7 Jul 06 10:19:15 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:15 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" returned: 0 in 0.856s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:16 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa Jul 06 10:19:16 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:16 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0f16542b-773a-40c3-8894-569c94f3b7b7" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-quobyte-0f16542b-773a-40c3-8894-569c94f3b7b7" released by "delete_volume" :: held 1.728s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Created reservations ['814e6f09-7285-4576-b2f1-339c5da70494', '36cfc640-cc15-43fa-8372-7aa155f2070b', 'c75e7353-24ad-4a99-9274-d95889a396cf', '472bb53c-6ce9-49ee-88fc-4ecdba3c369d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:16 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:16 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:16 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" returned: 1 in 0.908s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:19:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:16 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa Jul 06 10:19:16 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:17 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.802s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Deleted volume successfully. Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8e76128e-a1c9-440e-872f-4f6623d06a39 tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-0f16542b-773a-40c3-8894-569c94f3b7b7-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Flow 'volume_create_manager' (5401aa4b-90c3-49cb-a2f8-9fdba23053b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021218aa-d810-4723-9863-c99a6a6d98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021218aa-d810-4723-9863-c99a6a6d98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1564313496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38050a34-3bdd-444b-8f6a-52bfec0736a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6158c14103834a3ba4e45842c4e9a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:18Z,use_quota=True,user_id='23ae1a39a9a3488ab109f680e176674d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07de3fa3-63f9-4508-9264-da0e15663aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07de3fa3-63f9-4508-9264-da0e15663aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:17 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a13e04d-c01e-436c-8cd7-370baddd71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a13e04d-c01e-436c-8cd7-370baddd71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38050a34-3bdd-444b-8f6a-52bfec0736a6', 'volume_name': 'volume-38050a34-3bdd-444b-8f6a-52bfec0736a6', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342950b6-2fc0-4c6b-af0e-3da631468931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342950b6-2fc0-4c6b-af0e-3da631468931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14c5ad3-7f66-4f0b-9558-a6bbb47ed64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:17 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Volume 38050a34-3bdd-444b-8f6a-52bfec0736a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38050a34-3bdd-444b-8f6a-52bfec0736a6', 'volume_size': 1} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1564313496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38050a34-3bdd-444b-8f6a-52bfec0736a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6158c14103834a3ba4e45842c4e9a4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:18Z,use_quota=True,user_id='23ae1a39a9a3488ab109f680e176674d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Creating volume 38050a34-3bdd-444b-8f6a-52bfec0736a6 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:17 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" returned: 0 in 0.873s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Lock "cinder-quobyte-4cacca8f-a4d0-40dc-ab40-81527a0e0caa" released by "delete_volume" :: held 2.699s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:17 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 1073741824 Jul 06 10:19:17 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Created reservations ['2ee96940-d5ef-409f-90bc-06a81e887c62', '0bd6ce5c-3d43-49ef-a238-728e77366767', 'fa0baa9a-ad48-4fef-931e-eae4e176f5eb', '8728611a-38c8-4a27-a3cf-caed1ca4b31c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:17 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:17 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:18 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.798s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:18 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Deleted volume successfully. Jul 06 10:19:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b143900-673d-4e55-95f6-5088b8b53b1d tempest-VolumeImageDependencyTests-1024162387 None] Lock "cinder-4cacca8f-a4d0-40dc-ab40-81527a0e0caa-delete_volume" released by "delete_volume" :: held 3.829s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:18 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 1073741824" returned: 0 in 1.183s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:18 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 Jul 06 10:19:18 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:19 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6" returned: 0 in 0.796s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b14c5ad3-7f66-4f0b-9558-a6bbb47ed64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38050a34-3bdd-444b-8f6a-52bfec0736a6', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cf67ef-1520-4062-b95e-65b41924d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:19 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Volume volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 (38050a34-3bdd-444b-8f6a-52bfec0736a6): created successfully Jul 06 10:19:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cf67ef-1520-4062-b95e-65b41924d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Flow 'volume_create_manager' (5401aa4b-90c3-49cb-a2f8-9fdba23053b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:19 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b187e960-fb46-45d9-b28a-46588d77961a tempest-VolumesTransfersV355Test-1380927584 None] Created volume successfully. Jul 06 10:19:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Acquiring lock "cinder-38050a34-3bdd-444b-8f6a-52bfec0736a6-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-38050a34-3bdd-444b-8f6a-52bfec0736a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Acquiring lock "cinder-quobyte-38050a34-3bdd-444b-8f6a-52bfec0736a6" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-quobyte-38050a34-3bdd-444b-8f6a-52bfec0736a6" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:21 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e471900-7e6e-47b7-975f-95b199e76ad9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:21 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 Jul 06 10:19:21 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:22 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6" returned: 0 in 0.900s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:22 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6 Jul 06 10:19:22 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:22 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38050a34-3bdd-444b-8f6a-52bfec0736a6" returned: 0 in 0.770s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-quobyte-38050a34-3bdd-444b-8f6a-52bfec0736a6" released by "delete_volume" :: held 1.730s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Created reservations ['81beee2f-0553-4e0b-9616-ecc3db365265', 'eb8c404d-0196-471f-b8a6-4fae1c5f835b', '3a5a00d3-858e-4f35-9a62-269333007f30', '795e09d5-674b-497c-8a86-fa9606179e2e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:23 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:23 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:24 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.904s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:24 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:24 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Deleted volume successfully. Jul 06 10:19:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d869cf24-ddb3-401a-bccc-32299ea10a9e tempest-VolumesTransfersV355Test-374723739 None] Lock "cinder-38050a34-3bdd-444b-8f6a-52bfec0736a6-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Flow 'volume_create_manager' (a60f9183-415f-4b6a-b301-4f4b97ffdc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd681a00-bf24-4193-84b1-6b840eeed74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd681a00-bf24-4193-84b1-6b840eeed74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1533049119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b451fe4-8fae-4361-b2d2-5e7128db38b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b8e9fe69474cdabe3d37bf4cf5e048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:30Z,use_quota=True,user_id='e7a62f3348474fdf87d0b24f8be19f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03984c2-3e6c-47fa-abb9-dac874fe6fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c03984c2-3e6c-47fa-abb9-dac874fe6fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08c34e7-d39d-4a8d-9fbf-d400dfea6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08c34e7-d39d-4a8d-9fbf-d400dfea6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b451fe4-8fae-4361-b2d2-5e7128db38b0', 'volume_name': 'volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c3421c-8755-4ac3-8dc0-ac76d5847c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c3421c-8755-4ac3-8dc0-ac76d5847c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f3a9e5-57b3-4201-bb29-53edd12aa546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Volume 8b451fe4-8fae-4361-b2d2-5e7128db38b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0', 'volume_size': 1} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1533049119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b451fe4-8fae-4361-b2d2-5e7128db38b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b8e9fe69474cdabe3d37bf4cf5e048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:30Z,use_quota=True,user_id='e7a62f3348474fdf87d0b24f8be19f80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Creating volume 8b451fe4-8fae-4361-b2d2-5e7128db38b0 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:29 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:29 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 1073741824 Jul 06 10:19:29 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Flow 'volume_create_manager' (2687d8a5-814b-4cde-8363-92532f5612d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc73017-e0a4-4900-a828-e71ab2a69785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc73017-e0a4-4900-a828-e71ab2a69785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1828399522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d261dfa-9df0-486b-a332-4c4d999c070a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d54cfe5fef41628e4e32e462eaae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:30Z,use_quota=True,user_id='7b9c7bd98dfc4445bc37a1fcc87f4736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253dee59-9818-4533-8b06-f6133bbbd99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253dee59-9818-4533-8b06-f6133bbbd99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476311ca-c70d-4e8a-83b6-84eb69cd2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476311ca-c70d-4e8a-83b6-84eb69cd2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d261dfa-9df0-486b-a332-4c4d999c070a', 'volume_name': 'volume-4d261dfa-9df0-486b-a332-4c4d999c070a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c4004d-edc8-4096-acbf-a199fa24dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c4004d-edc8-4096-acbf-a199fa24dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4eb22e-19c4-4e5c-b837-373330fb110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:30 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Volume 4d261dfa-9df0-486b-a332-4c4d999c070a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d261dfa-9df0-486b-a332-4c4d999c070a', 'volume_size': 1} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:30 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 1073741824" returned: 0 in 0.921s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=137,cinder:UPDATE=198,cinder:DELETE=20,cinder:INSERT=43 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=130,cinder:UPDATE=195,cinder:INSERT=54,cinder:DELETE=14 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:19:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:30 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 Jul 06 10:19:30 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:31 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0" returned: 0 in 0.670s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.952s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1828399522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d261dfa-9df0-486b-a332-4c4d999c070a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d54cfe5fef41628e4e32e462eaae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:30Z,use_quota=True,user_id='7b9c7bd98dfc4445bc37a1fcc87f4736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Creating volume 4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:31 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f3a9e5-57b3-4201-bb29-53edd12aa546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:31 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a 1073741824 Jul 06 10:19:31 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fcc27bf-56aa-484f-a87f-4361f55d9fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:31 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Volume volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 (8b451fe4-8fae-4361-b2d2-5e7128db38b0): created successfully Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fcc27bf-56aa-484f-a87f-4361f55d9fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Flow 'volume_create_manager' (a60f9183-415f-4b6a-b301-4f4b97ffdc4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5e49e7e3-b3e0-44a0-8518-f56e0192e5a8 tempest-VolumesNegativeTest-993482851 None] Created volume successfully. Jul 06 10:19:32 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a 1073741824" returned: 0 in 0.867s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:32 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a Jul 06 10:19:32 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:33 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a" returned: 0 in 0.797s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb4eb22e-19c4-4e5c-b837-373330fb110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d261dfa-9df0-486b-a332-4c4d999c070a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb8d51c-278f-48cd-8b19-985e4802f88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Volume volume-4d261dfa-9df0-486b-a332-4c4d999c070a (4d261dfa-9df0-486b-a332-4c4d999c070a): created successfully Jul 06 10:19:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb8d51c-278f-48cd-8b19-985e4802f88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Flow 'volume_create_manager' (2687d8a5-814b-4cde-8363-92532f5612d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:33 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8c446c93-8e05-47bc-8c5b-48e4f6a51eee tempest-VolumesCloneTest-232734928 None] Created volume successfully. Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Flow 'volume_create_manager' (0ee973bc-fe30-494d-9f26-05ffbe8a04a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b311024d-185d-45d9-89c3-93ea4f525821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b311024d-185d-45d9-89c3-93ea4f525821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-893472468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4216ed76-22a9-4016-ac82-97ebcf28e2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44d54cfe5fef41628e4e32e462eaae08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=4d261dfa-9df0-486b-a332-4c4d999c070a,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:34Z,use_quota=True,user_id='7b9c7bd98dfc4445bc37a1fcc87f4736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5e922a-2320-4ae8-9662-46747279f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5e922a-2320-4ae8-9662-46747279f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a7573b-fba6-4af6-a7b6-3e5fca5bbbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a7573b-fba6-4af6-a7b6-3e5fca5bbbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4216ed76-22a9-4016-ac82-97ebcf28e2e4', 'volume_name': 'volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4', 'volume_size': 2, 'source_volid': '4d261dfa-9df0-486b-a332-4c4d999c070a', 'source_volstatus': 'available'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c4ac79-7f9e-45c0-95bd-d7c46bacc7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c4ac79-7f9e-45c0-95bd-d7c46bacc7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a73d55e-e741-4fc3-8fd4-f3cf48a11c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Volume 4216ed76-22a9-4016-ac82-97ebcf28e2e4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4', 'volume_size': 2, 'source_volid': '4d261dfa-9df0-486b-a332-4c4d999c070a', 'source_volstatus': 'available'} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:34 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Cloning volume 4d261dfa-9df0-486b-a332-4c4d999c070a to volume 4216ed76-22a9-4016-ac82-97ebcf28e2e4 Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Creating offline snapshot a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 of volume 4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[4983fc35-42c0-47cb-bc88-5a11f8bdd1d3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:34 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a Jul 06 10:19:34 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (6351da3a-d389-4d13-91f1-a00dcc19a0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d0713c-682e-40ad-a6c7-f832fb72a4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d0713c-682e-40ad-a6c7-f832fb72a4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153340446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be681b5b-5159-42ae-a582-59bf76ddd5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:35Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd9bca5-f0a8-40d9-840a-6589f1de0db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd9bca5-f0a8-40d9-840a-6589f1de0db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f0af37-8a85-473b-934f-e272ddaab7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59f0af37-8a85-473b-934f-e272ddaab7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be681b5b-5159-42ae-a582-59bf76ddd5ef', 'volume_name': 'volume-be681b5b-5159-42ae-a582-59bf76ddd5ef', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e45045-2475-454c-b7aa-ce4ae7213519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e45045-2475-454c-b7aa-ce4ae7213519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76619202-6970-4856-923a-a29ec7ccab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Volume be681b5b-5159-42ae-a582-59bf76ddd5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be681b5b-5159-42ae-a582-59bf76ddd5ef', 'volume_size': 1} Jul 06 10:19:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:35 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a" returned: 0 in 0.776s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:35 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 1G Jul 06 10:19:35 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:35 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 1G" returned: 0 in 0.792s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d261dfa-9df0-486b-a332-4c4d999c070a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:35 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d261dfa-9df0-486b-a332-4c4d999c070a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 Jul 06 10:19:35 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:36 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d261dfa-9df0-486b-a332-4c4d999c070a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" returned: 0 in 0.654s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:36 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 is being set with open permissions: ugo+rw Jul 06 10:19:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:36 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 Jul 06 10:19:36 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:37 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" returned: 0 in 0.665s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:37 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.info Jul 06 10:19:37 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:37 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.info" returned: 0 in 0.649s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:37 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.info is being set with open permissions: ugo+rw Jul 06 10:19:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:37 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.info Jul 06 10:19:37 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:38 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.info" returned: 0 in 0.657s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Acquiring lock "cinder-quobyte-4216ed76-22a9-4016-ac82-97ebcf28e2e4" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-4216ed76-22a9-4016-ac82-97ebcf28e2e4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] snapshot: a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20, volume: 4216ed76-22a9-4016-ac82-97ebcf28e2e4, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af4f20b-e144-4ce0-8720-424be54a23c3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:38 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 Jul 06 10:19:38 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:39 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" returned: 0 in 0.840s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d261dfa-9df0-486b-a332-4c4d999c070a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:19:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:19:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:19:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5457ab-06bd-46af-a376-382a5dcf706c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:39 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a Jul 06 10:19:39 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:40 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a" returned: 0 in 0.781s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:40 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:19:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:40 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 Jul 06 10:19:40 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:45 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4" returned: 0 in 5.414s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:45 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4750355-e937-47cb-94e9-1a2ab24b96e6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:45 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a Jul 06 10:19:45 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:46 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a" returned: 0 in 1.106s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:46 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:19:46 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Converted 1024.00 MB image at 188.99 MB/s Jul 06 10:19:46 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 is being set with open permissions: ugo+rw Jul 06 10:19:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:46 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 Jul 06 10:19:46 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:INSERT=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:19:47 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4" returned: 0 in 0.650s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-4216ed76-22a9-4016-ac82-97ebcf28e2e4" released by "_copy_volume_from_snapshot" :: held 8.908s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Acquiring lock "cinder-quobyte-a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Deleting offline snapshot a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 of volume 4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] snapshot_file for this snap is: volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f3be65-e0cc-46dd-a093-739aa1965520]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:47 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 Jul 06 10:19:47 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:48 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" returned: 0 in 0.875s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d261dfa-9df0-486b-a332-4c4d999c070a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:19:48 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e6db2-4f5e-45f2-bb45-5cbb5bad28b9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:48 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a Jul 06 10:19:48 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:49 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a" returned: 0 in 0.852s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:49 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 Jul 06 10:19:49 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:50 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" returned: 0 in 0.786s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:50 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20 Jul 06 10:19:50 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:50 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a.a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" returned: 0 in 0.668s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-a96c2942-5a2f-4da4-b7c9-5a7bb60d2b20" released by "_delete_snapshot" :: held 3.279s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.572s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.249s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-153340446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be681b5b-5159-42ae-a582-59bf76ddd5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:35Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Creating volume be681b5b-5159-42ae-a582-59bf76ddd5ef {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:50 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a73d55e-e741-4fc3-8fd4-f3cf48a11c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4', 'volume_size': 2, 'source_volid': '4d261dfa-9df0-486b-a332-4c4d999c070a', 'source_volstatus': 'available'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:50 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef 1073741824 Jul 06 10:19:50 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5712755-0563-4113-9559-3fe2b1c60c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Volume volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 (4216ed76-22a9-4016-ac82-97ebcf28e2e4): created successfully Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5712755-0563-4113-9559-3fe2b1c60c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Flow 'volume_create_manager' (0ee973bc-fe30-494d-9f26-05ffbe8a04a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b7d0a731-e33b-483c-a1ee-980d3102a087 tempest-VolumesCloneTest-232734928 None] Created volume successfully. Jul 06 10:19:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Acquiring lock "cinder-4216ed76-22a9-4016-ac82-97ebcf28e2e4-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Lock "cinder-4216ed76-22a9-4016-ac82-97ebcf28e2e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Acquiring lock "cinder-quobyte-4216ed76-22a9-4016-ac82-97ebcf28e2e4" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-4216ed76-22a9-4016-ac82-97ebcf28e2e4" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:51 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e786bb5-8d4b-4c8d-a49a-7489c64e893d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:51 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef 1073741824" returned: 0 in 1.055s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:52 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 Jul 06 10:19:52 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:52 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef Jul 06 10:19:52 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:52 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef" returned: 0 in 0.771s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:52 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76619202-6970-4856-923a-a29ec7ccab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be681b5b-5159-42ae-a582-59bf76ddd5ef', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec7e871-1931-42b1-a21f-ba762661c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4" returned: 0 in 0.892s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Volume volume-be681b5b-5159-42ae-a582-59bf76ddd5ef (be681b5b-5159-42ae-a582-59bf76ddd5ef): created successfully Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ec7e871-1931-42b1-a21f-ba762661c972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:52 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4 Jul 06 10:19:52 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (6351da3a-d389-4d13-91f1-a00dcc19a0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a4ff552c-0669-489d-be2e-49c8c64c6008 tempest-ProjectReaderTests-1365459826 None] Created volume successfully. Jul 06 10:19:53 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4216ed76-22a9-4016-ac82-97ebcf28e2e4" returned: 0 in 0.646s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-4216ed76-22a9-4016-ac82-97ebcf28e2e4" released by "delete_volume" :: held 1.588s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-be681b5b-5159-42ae-a582-59bf76ddd5ef-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Created reservations ['1a052d85-928e-497e-bb82-ed6c856ca710', '96cf5ffe-aa44-48e0-b3ff-4f1c70908805', 'b1408fea-d549-4d82-8e81-57ce3c176e88', 'f6c3f379-e687-40c0-9b19-9fe00b4b45d5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-be681b5b-5159-42ae-a582-59bf76ddd5ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-quobyte-be681b5b-5159-42ae-a582-59bf76ddd5ef" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-be681b5b-5159-42ae-a582-59bf76ddd5ef" acquired by "delete_volume" :: waited 0.042s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:53 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:53 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2fbe3f-eef8-424c-bf5a-85f385b11625]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:53 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef Jul 06 10:19:53 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Acquiring lock "cinder-4d261dfa-9df0-486b-a332-4c4d999c070a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Lock "cinder-4d261dfa-9df0-486b-a332-4c4d999c070a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Acquiring lock "cinder-quobyte-4d261dfa-9df0-486b-a332-4c4d999c070a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-4d261dfa-9df0-486b-a332-4c4d999c070a" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[56df5ed6-4cc4-478a-910c-330e77870775]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:54 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a Jul 06 10:19:54 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:54 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.746s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:54 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Deleted volume successfully. Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7f01dc30-87e3-478d-9e87-77a6ca0e3b74 tempest-VolumesCloneTest-232734928 None] Lock "cinder-4216ed76-22a9-4016-ac82-97ebcf28e2e4-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:54 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef" returned: 0 in 0.829s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:54 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef Jul 06 10:19:54 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:55 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a" returned: 0 in 0.788s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:55 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a Jul 06 10:19:55 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:55 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-be681b5b-5159-42ae-a582-59bf76ddd5ef" returned: 0 in 0.645s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-be681b5b-5159-42ae-a582-59bf76ddd5ef" released by "delete_volume" :: held 1.524s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Created reservations ['6d3c9100-6be6-4fd2-a1c9-1e6b3c58c16a', '9af06574-7d1e-45ba-b9b1-0cc754f1d5a0', 'ba44f805-bbb4-4385-a20c-116d7b5148c0', 'a9521090-ea5f-4a98-a0f2-f4ef574212b5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:55 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:55 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:55 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4d261dfa-9df0-486b-a332-4c4d999c070a" returned: 0 in 0.645s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Lock "cinder-quobyte-4d261dfa-9df0-486b-a332-4c4d999c070a" released by "delete_volume" :: held 1.521s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Created reservations ['3159bc54-1627-4e6c-8482-3de1b3f37967', 'b2977e2f-4942-4692-a22d-e6e40c027410', 'd42f3044-bbe0-4cd3-b888-a8cbd18008c4', '49ca3fe7-e07f-40d3-8bce-6e2b3ac79d56'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:55 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:55 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:56 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.713s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Deleted volume successfully. Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-917d479e-556f-46b7-b36f-e298f9d48b05 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-be681b5b-5159-42ae-a582-59bf76ddd5ef-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (a409e4a2-3e95-42e1-afd4-e6b0454536c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff601b7-1448-4892-b474-7aa8bfb873c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff601b7-1448-4892-b474-7aa8bfb873c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81715541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa945b7-6822-403d-8930-9dd4287181ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:56Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2570d68b-4877-40e1-8282-e143f70fa276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2570d68b-4877-40e1-8282-e143f70fa276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f5d5d4-c6d7-43b1-b34b-df9df1ceb43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f5d5d4-c6d7-43b1-b34b-df9df1ceb43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa945b7-6822-403d-8930-9dd4287181ad', 'volume_name': 'volume-daa945b7-6822-403d-8930-9dd4287181ad', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e2d5b6-d6ac-497e-b55e-70d461a6572e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e2d5b6-d6ac-497e-b55e-70d461a6572e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b5a85a-9cf0-4186-ae6f-1167723a8085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Volume daa945b7-6822-403d-8930-9dd4287181ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa945b7-6822-403d-8930-9dd4287181ad', 'volume_size': 1} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81715541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa945b7-6822-403d-8930-9dd4287181ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:19:56Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Creating volume daa945b7-6822-403d-8930-9dd4287181ad {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:19:56 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:56 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad 1073741824 Jul 06 10:19:56 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:56 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.665s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Deleted volume successfully. Jul 06 10:19:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-8d94c8db-7ec3-4478-82fb-c048ab26f39e tempest-VolumesCloneTest-232734928 None] Lock "cinder-4d261dfa-9df0-486b-a332-4c4d999c070a-delete_volume" released by "delete_volume" :: held 2.456s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:19:57 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad 1073741824" returned: 0 in 1.039s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:57 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad Jul 06 10:19:57 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:58 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad" returned: 0 in 0.709s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b5a85a-9cf0-4186-ae6f-1167723a8085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa945b7-6822-403d-8930-9dd4287181ad', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32109d0-0e33-4ae0-9ba1-b26498cf2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:19:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Volume volume-daa945b7-6822-403d-8930-9dd4287181ad (daa945b7-6822-403d-8930-9dd4287181ad): created successfully Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c32109d0-0e33-4ae0-9ba1-b26498cf2238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (a409e4a2-3e95-42e1-afd4-e6b0454536c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:19:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fa58eb10-dc1e-45f6-ba83-7d93b74d80f9 tempest-ProjectReaderTests-1365459826 None] Created volume successfully. Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-daa945b7-6822-403d-8930-9dd4287181ad-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-daa945b7-6822-403d-8930-9dd4287181ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-quobyte-daa945b7-6822-403d-8930-9dd4287181ad" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-daa945b7-6822-403d-8930-9dd4287181ad" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[75028d86-46fc-446f-b5ca-e16341ef2e96]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:58 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad Jul 06 10:19:58 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:19:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:58 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:19:58 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:59 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad" returned: 0 in 0.997s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:19:59 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad Jul 06 10:19:59 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:19:59 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Jul 06 10:19:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.802s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:19:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:19:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:19:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:19:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Flow 'volume_create_manager' (faabff30-2acb-4d12-9ad8-d0faa063ce5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54416f4-f543-4ae8-b02b-32d1e63c57de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54416f4-f543-4ae8-b02b-32d1e63c57de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-910573837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40524529-1502-4a3d-9898-2e6d1f4a8acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4c3af82ae74dad85d99ebb5c244f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:00Z,use_quota=True,user_id='dbac5b1e0a704949a0cf0617ab16547f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f5050f-9937-4551-85df-1a6b5c6b8130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f5050f-9937-4551-85df-1a6b5c6b8130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae1e15a-2b83-4d8a-9342-a863bb2fdbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:20:00 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-daa945b7-6822-403d-8930-9dd4287181ad" returned: 0 in 0.759s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-daa945b7-6822-403d-8930-9dd4287181ad" released by "delete_volume" :: held 1.810s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Created reservations ['bd321cb5-60de-4d24-bfc7-19e4e92214b9', 'ac2db6be-82e1-4b89-a26b-d4ef1e108f3d', 'b5fb844d-d337-48c3-8513-840c4e087d36', '5b8b484e-61b5-4678-b89a-8aa840f4ef1d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae1e15a-2b83-4d8a-9342-a863bb2fdbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40524529-1502-4a3d-9898-2e6d1f4a8acb', 'volume_name': 'volume-40524529-1502-4a3d-9898-2e6d1f4a8acb', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778e3c11-6224-4447-966d-4b83e75ccf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778e3c11-6224-4447-966d-4b83e75ccf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064672b3-1026-4ee2-889b-dbe271419022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:00 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Volume 40524529-1502-4a3d-9898-2e6d1f4a8acb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40524529-1502-4a3d-9898-2e6d1f4a8acb', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Trying to clone 40524529-1502-4a3d-9898-2e6d1f4a8acb from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:00 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:00 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:20:01 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Image download 20.69 MB at 20.69 MB/s Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d85e34-060d-4614-af34-c675426e27fc]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:01 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.796s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Deleted volume successfully. Jul 06 10:20:01 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD Jul 06 10:20:01 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1301bbfe-b1d8-4232-8e41-79748e379ed5 tempest-ProjectReaderTests-1365459826 None] Lock "cinder-daa945b7-6822-403d-8930-9dd4287181ad-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (4460d250-1ccb-46e4-aea0-6a03cb66b2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3acbe49c-f19e-432f-a5b1-a5c11d31c51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3acbe49c-f19e-432f-a5b1-a5c11d31c51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2089459604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65d090b-d486-47cb-9a67-2783caae5d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:01Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b4b550-82c0-436c-b09b-4208e4525f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b4b550-82c0-436c-b09b-4208e4525f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8986f6-572d-4a73-890c-b80323e8bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8986f6-572d-4a73-890c-b80323e8bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65d090b-d486-47cb-9a67-2783caae5d78', 'volume_name': 'volume-d65d090b-d486-47cb-9a67-2783caae5d78', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b785cdc-ea12-4e53-8b57-95f5040076fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b785cdc-ea12-4e53-8b57-95f5040076fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8c0265-02ca-4b9e-90ec-4a08b9a71894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Volume d65d090b-d486-47cb-9a67-2783caae5d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65d090b-d486-47cb-9a67-2783caae5d78', 'volume_size': 1} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2089459604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65d090b-d486-47cb-9a67-2783caae5d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:01Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Creating volume d65d090b-d486-47cb-9a67-2783caae5d78 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:01 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:20:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:01 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 1073741824 Jul 06 10:20:01 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:02 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 is fetched for user dbac5b1e0a704949a0cf0617ab16547f. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c383f9-977f-4663-9fac-f8a8199abe6d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:02 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD Jul 06 10:20:02 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:02 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 1073741824" returned: 0 in 0.898s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:02 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 Jul 06 10:20:02 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:02 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:03 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78" returned: 0 in 0.710s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-910573837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40524529-1502-4a3d-9898-2e6d1f4a8acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4c3af82ae74dad85d99ebb5c244f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:00Z,use_quota=True,user_id='dbac5b1e0a704949a0cf0617ab16547f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Creating volume 40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:03 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8c0265-02ca-4b9e-90ec-4a08b9a71894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65d090b-d486-47cb-9a67-2783caae5d78', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:03 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 1073741824 Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2c863c-89cb-4367-9099-2fb4a4064e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:03 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Volume volume-d65d090b-d486-47cb-9a67-2783caae5d78 (d65d090b-d486-47cb-9a67-2783caae5d78): created successfully Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2c863c-89cb-4367-9099-2fb4a4064e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (4460d250-1ccb-46e4-aea0-6a03cb66b2f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0cc2a241-7e74-4129-a375-c8597400375e tempest-ProjectReaderTests-1365459826 None] Created volume successfully. Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-d65d090b-d486-47cb-9a67-2783caae5d78-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-d65d090b-d486-47cb-9a67-2783caae5d78-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-quobyte-d65d090b-d486-47cb-9a67-2783caae5d78" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-d65d090b-d486-47cb-9a67-2783caae5d78" acquired by "delete_volume" :: waited 0.030s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59eecd5-7d3e-446e-be5a-60c5211651b9]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:03 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 Jul 06 10:20:03 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:04 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 1073741824" returned: 0 in 1.007s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:04 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:04 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Acquiring lock "cinder-8b451fe4-8fae-4361-b2d2-5e7128db38b0-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Lock "cinder-8b451fe4-8fae-4361-b2d2-5e7128db38b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Acquiring lock "cinder-quobyte-8b451fe4-8fae-4361-b2d2-5e7128db38b0" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Lock "cinder-quobyte-8b451fe4-8fae-4361-b2d2-5e7128db38b0" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[112eee9b-0873-43cc-858a-ae76c8e712f5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:04 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78" returned: 0 in 0.855s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:04 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78 Jul 06 10:20:04 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:04 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 Jul 06 10:20:04 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:05 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 0 in 0.695s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Attempting download of 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume 40524529-1502-4a3d-9898-2e6d1f4a8acb. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05b004a-dc8a-4159-b4b8-aeec5b42025b]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wfp3zt5s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:05 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wfp3zt5s Jul 06 10:20:05 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:05 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d65d090b-d486-47cb-9a67-2783caae5d78" returned: 0 in 0.697s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-d65d090b-d486-47cb-9a67-2783caae5d78" released by "delete_volume" :: held 1.610s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:05 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:05 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0 Jul 06 10:20:05 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Created reservations ['224ddfe1-7010-4acc-850a-50a0eedfdced', '137a6b0e-392c-42de-8937-2e78357361f5', '5d96fa2b-3faf-4280-9222-8e2c457637ee', '6a02b627-a800-4e1e-9dc9-869a6ea4facb'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:05 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:05 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:05 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wfp3zt5s" returned: 0 in 0.782s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wfp3zt5s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:06 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wfp3zt5s Jul 06 10:20:06 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:06 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b451fe4-8fae-4361-b2d2-5e7128db38b0" returned: 0 in 0.749s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Lock "cinder-quobyte-8b451fe4-8fae-4361-b2d2-5e7128db38b0" released by "delete_volume" :: held 1.619s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Created reservations ['1dd025b9-a1d5-48fd-873f-27e0bf9334d5', '474d55f3-b7d2-49a7-b8eb-1306aadf94ef', 'c8509991-2e4c-479a-b624-73a68812fcc7', '5057624a-4776-4261-a7e8-e3236ff19dba'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:06 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.865s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Deleted volume successfully. Jul 06 10:20:06 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:06 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-45d3a4d8-88c5-4929-bccf-5984d2b9ca1b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-d65d090b-d486-47cb-9a67-2783caae5d78-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (44223634-7c1c-4126-a844-687b91d71e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c178f27f-d866-499e-b9bb-b16ed42e731e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c178f27f-d866-499e-b9bb-b16ed42e731e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368992470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d2577d-e936-4198-88ed-a649d9a6a20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:06Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e33926-1c6f-4b72-a7d7-dc6853cd242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e33926-1c6f-4b72-a7d7-dc6853cd242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbbc36d-cbfe-4055-8ea4-59c8941e98fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbbc36d-cbfe-4055-8ea4-59c8941e98fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d2577d-e936-4198-88ed-a649d9a6a20c', 'volume_name': 'volume-71d2577d-e936-4198-88ed-a649d9a6a20c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3973f0f-ee89-4f36-b414-ee6908647e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3973f0f-ee89-4f36-b414-ee6908647e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705ed33c-f373-4e1e-be62-da1ffb070c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:06 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Volume 71d2577d-e936-4198-88ed-a649d9a6a20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d2577d-e936-4198-88ed-a649d9a6a20c', 'volume_size': 1} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368992470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d2577d-e936-4198-88ed-a649d9a6a20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1d33efe3c2499aa891e9dd017168c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:06Z,use_quota=True,user_id='f2e427aa30014dbd946a1104055d59fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Creating volume 71d2577d-e936-4198-88ed-a649d9a6a20c {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:06 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:06 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c 1073741824 Jul 06 10:20:06 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:06 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wfp3zt5s" returned: 1 in 0.856s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_wfp3zt5s' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5940a5d4-cb22-4841-94d9-07f7141c1e89]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:06 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD Jul 06 10:20:06 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:07 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Deleted volume successfully. Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4a9de1eb-5381-4ffb-9911-ec7397627ffd tempest-VolumesNegativeTest-993482851 None] Lock "cinder-8b451fe4-8fae-4361-b2d2-5e7128db38b0-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:07 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c 1073741824" returned: 0 in 0.931s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:07 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:07 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c Jul 06 10:20:07 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] 58ff08d4-fcf7-43ec-b9cb-ad129e740264 was qcow2, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:20:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:07 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:07 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:08 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c" returned: 0 in 0.703s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705ed33c-f373-4e1e-be62-da1ffb070c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d2577d-e936-4198-88ed-a649d9a6a20c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aa536e-b822-4b26-81f3-1d5dbb13e386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:08 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Volume volume-71d2577d-e936-4198-88ed-a649d9a6a20c (71d2577d-e936-4198-88ed-a649d9a6a20c): created successfully Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7aa536e-b822-4b26-81f3-1d5dbb13e386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Flow 'volume_create_manager' (44223634-7c1c-4126-a844-687b91d71e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-472bf027-fba0-4da3-9775-ac8361584289 tempest-ProjectReaderTests-1365459826 None] Created volume successfully. Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-71d2577d-e936-4198-88ed-a649d9a6a20c-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-71d2577d-e936-4198-88ed-a649d9a6a20c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Acquiring lock "cinder-quobyte-71d2577d-e936-4198-88ed-a649d9a6a20c" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-71d2577d-e936-4198-88ed-a649d9a6a20c" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[34582879-a71d-4cb5-8bba-13cf80fb5803]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:08 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c Jul 06 10:20:08 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:09 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c" returned: 0 in 0.843s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:09 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c Jul 06 10:20:09 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:09 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 0 in 2.228s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:09 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_a3kqehxqdevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:20:09 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Converted 112.00 MB image at 50.25 MB/s Jul 06 10:20:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:09 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 1G Jul 06 10:20:09 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:10 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-71d2577d-e936-4198-88ed-a649d9a6a20c" returned: 0 in 0.683s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-quobyte-71d2577d-e936-4198-88ed-a649d9a6a20c" released by "delete_volume" :: held 1.605s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Created reservations ['a27391ad-455f-48f7-b7b5-321ac19b3fb1', '9d4aba42-2106-41bf-836d-fb29b1c6f11a', 'ec5d5730-4532-4b2d-a8ff-e18a3fcd9b5c', '2a472411-d0b5-4c6f-a78a-8e140b7b44f9'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:10 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:10 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:10 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 1G" returned: 0 in 0.835s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cba77d-d8a2-40a2-ba27-fa42f3a74e9b]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:10 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:10 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:11 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:11 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:11 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Deleted volume successfully. Jul 06 10:20:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b748cb33-9dc9-466f-b845-99f8b7ae1f8b tempest-ProjectReaderTests-1365459826 None] Lock "cinder-71d2577d-e936-4198-88ed-a649d9a6a20c-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:11 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 0 in 0.964s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:11 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:11 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:12 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 1 in 0.931s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Downloaded image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume 40524529-1502-4a3d-9898-2e6d1f4a8acb successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 for user dbac5b1e0a704949a0cf0617ab16547f is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Marking volume 40524529-1502-4a3d-9898-2e6d1f4a8acb as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Copying metadata from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 to 40524529-1502-4a3d-9898-2e6d1f4a8acb. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Creating volume glance metadata for volume 40524529-1502-4a3d-9898-2e6d1f4a8acb backed by image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064672b3-1026-4ee2-889b-dbe271419022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40524529-1502-4a3d-9898-2e6d1f4a8acb', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411929af-9ace-48f4-bfcf-b9980b2c320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:12 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Volume volume-40524529-1502-4a3d-9898-2e6d1f4a8acb (40524529-1502-4a3d-9898-2e6d1f4a8acb): created successfully Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (411929af-9ace-48f4-bfcf-b9980b2c320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Flow 'volume_create_manager' (faabff30-2acb-4d12-9ad8-d0faa063ce5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-71012f2a-7922-4e3f-a170-05e5b0b6c2b0 tempest-VolumesExtendTest-1928057171 None] Created volume successfully. Jul 06 10:20:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca44648-866e-4421-96cd-cb556983e219]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:13 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:13 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:14 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 0 in 0.948s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:14 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:14 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:15 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 1 in 0.832s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 2G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb 2G" returned: 0 in 0.078s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.899s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fdacf7ab-becc-4767-ad0a-b1cfd5234050 tempest-VolumesExtendTest-1928057171 None] Extend volume completed successfully. Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Acquiring lock "cinder-40524529-1502-4a3d-9898-2e6d1f4a8acb-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Lock "cinder-40524529-1502-4a3d-9898-2e6d1f4a8acb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Acquiring lock "cinder-quobyte-40524529-1502-4a3d-9898-2e6d1f4a8acb" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-40524529-1502-4a3d-9898-2e6d1f4a8acb" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b365860-9db6-4241-971e-99325b36cbbf]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:15 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:15 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:16 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 0 in 0.900s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:16 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:16 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:17 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 1 in 0.782s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:20:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:17 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb Jul 06 10:20:17 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:18 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-40524529-1502-4a3d-9898-2e6d1f4a8acb" returned: 0 in 0.826s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-40524529-1502-4a3d-9898-2e6d1f4a8acb" released by "delete_volume" :: held 2.592s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Created reservations ['ab2d6c47-cb57-4f60-8abf-e9eca64bac71', '2ce1e9a5-9146-4664-b211-b16bf7ae527b', '414e2be7-7de1-4f70-ae1d-680a87a6be65', '4a9e5f4f-345b-4c7b-ad91-3865586f60c8'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:18 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:18 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:19 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:19 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Deleted volume successfully. Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-57b6ffea-c729-4584-8663-4c26ae48020c tempest-VolumesExtendTest-1928057171 None] Lock "cinder-40524529-1502-4a3d-9898-2e6d1f4a8acb-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (9a822a41-418c-4748-8fce-df160aa311ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6898de2-0eb8-4667-9a48-faf120b6fe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6898de2-0eb8-4667-9a48-faf120b6fe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-636254520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c33328a-377f-4cb9-b60c-4d4003554d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:20Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040d9faa-01e9-4b4d-a041-1370181bdfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040d9faa-01e9-4b4d-a041-1370181bdfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906278ba-091f-47f8-ab32-2749505f90e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906278ba-091f-47f8-ab32-2749505f90e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c33328a-377f-4cb9-b60c-4d4003554d99', 'volume_name': 'volume-0c33328a-377f-4cb9-b60c-4d4003554d99', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1821557-8234-4079-a472-4c79d2a3383c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1821557-8234-4079-a472-4c79d2a3383c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc59aee-70a9-466f-88e8-2abab50740e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume 0c33328a-377f-4cb9-b60c-4d4003554d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c33328a-377f-4cb9-b60c-4d4003554d99', 'volume_size': 1} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-636254520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c33328a-377f-4cb9-b60c-4d4003554d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:20Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Creating volume 0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:19 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:19 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 1073741824 Jul 06 10:20:19 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Flow 'volume_create_manager' (b64f132f-2691-420d-b385-5745208cf365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17f83e1-c0ae-4f83-b872-2c384b5211d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17f83e1-c0ae-4f83-b872-2c384b5211d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2123319685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cee604f-8464-4112-b014-d0af8f8d31df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4c3af82ae74dad85d99ebb5c244f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:20Z,use_quota=True,user_id='dbac5b1e0a704949a0cf0617ab16547f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c99867f-eca6-4492-9200-41946336bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c99867f-eca6-4492-9200-41946336bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38376cde-cd93-4fdd-afed-03437f2e6b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38376cde-cd93-4fdd-afed-03437f2e6b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cee604f-8464-4112-b014-d0af8f8d31df', 'volume_name': 'volume-1cee604f-8464-4112-b014-d0af8f8d31df', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdd8db8-4d84-4e15-8d2c-a1d1faf4936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdd8db8-4d84-4e15-8d2c-a1d1faf4936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66257ced-bfbf-4739-971c-5a13dc69e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:19 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Volume 1cee604f-8464-4112-b014-d0af8f8d31df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cee604f-8464-4112-b014-d0af8f8d31df', 'volume_size': 1} Jul 06 10:20:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:20 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 1073741824" returned: 0 in 0.880s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:20 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 Jul 06 10:20:20 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:21 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99" returned: 0 in 0.639s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2123319685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cee604f-8464-4112-b014-d0af8f8d31df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da4c3af82ae74dad85d99ebb5c244f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:20Z,use_quota=True,user_id='dbac5b1e0a704949a0cf0617ab16547f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Creating volume 1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:21 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc59aee-70a9-466f-88e8-2abab50740e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c33328a-377f-4cb9-b60c-4d4003554d99', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:21 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df 1073741824 Jul 06 10:20:21 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ab4946-0af3-4976-bea8-154dfac0a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume volume-0c33328a-377f-4cb9-b60c-4d4003554d99 (0c33328a-377f-4cb9-b60c-4d4003554d99): created successfully Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ab4946-0af3-4976-bea8-154dfac0a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (9a822a41-418c-4748-8fce-df160aa311ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-93e5b1e0-62d2-4334-8fe7-a18776b69f09 tempest-VolumesSnapshotTestJSON-2039416257 None] Created volume successfully. Jul 06 10:20:22 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df 1073741824" returned: 0 in 0.804s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:22 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df Jul 06 10:20:22 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:22 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df" returned: 0 in 0.719s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.194s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Creating offline snapshot a30d9fb8-a11b-4b00-b55c-c24e50f33431 of volume 0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66257ced-bfbf-4739-971c-5a13dc69e483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cee604f-8464-4112-b014-d0af8f8d31df', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052518d2-440b-4129-8a3d-5ddc1fb2044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e629c8a-a6fe-4772-be69-eef3e723655c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Volume volume-1cee604f-8464-4112-b014-d0af8f8d31df (1cee604f-8464-4112-b014-d0af8f8d31df): created successfully Jul 06 10:20:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052518d2-440b-4129-8a3d-5ddc1fb2044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Flow 'volume_create_manager' (b64f132f-2691-420d-b385-5745208cf365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5ed36a14-5c3d-41a5-8c98-249ffad1d1e9 tempest-VolumesExtendTest-1928057171 None] Created volume successfully. Jul 06 10:20:23 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 Jul 06 10:20:23 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:23 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99" returned: 0 in 0.834s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:23 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 1G Jul 06 10:20:23 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:24 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 1G" returned: 0 in 0.805s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c33328a-377f-4cb9-b60c-4d4003554d99 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:24 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c33328a-377f-4cb9-b60c-4d4003554d99 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 Jul 06 10:20:24 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:25 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c33328a-377f-4cb9-b60c-4d4003554d99 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431" returned: 0 in 0.712s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:25 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 is being set with open permissions: ugo+rw Jul 06 10:20:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:25 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 Jul 06 10:20:25 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:26 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431" returned: 0 in 0.658s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:26 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.info Jul 06 10:20:26 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:26 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.info" returned: 0 in 0.635s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:26 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.info is being set with open permissions: ugo+rw Jul 06 10:20:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:26 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.info Jul 06 10:20:26 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:27 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.info" returned: 0 in 0.691s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.434s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.482s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Creating offline snapshot 63b6bbba-3fc1-4b41-9f30-9812da256ea4 of volume 1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:20:27 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60d2f3f-533d-4824-a657-fe0e196a6e8b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:27 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-320155ff-ecb7-4073-8d1f-0338111d3fde tempest-VolumesSnapshotTestJSON-2039416257 None] Create snapshot completed successfully Jul 06 10:20:27 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df Jul 06 10:20:27 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-a30d9fb8-a11b-4b00-b55c-c24e50f33431-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-a30d9fb8-a11b-4b00-b55c-c24e50f33431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-0c33328a-377f-4cb9-b60c-4d4003554d99" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-0c33328a-377f-4cb9-b60c-4d4003554d99" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-a30d9fb8-a11b-4b00-b55c-c24e50f33431" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-a30d9fb8-a11b-4b00-b55c-c24e50f33431" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Deleting offline snapshot a30d9fb8-a11b-4b00-b55c-c24e50f33431 of volume 0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:20:28 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] snapshot_file for this snap is: volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df" returned: 0 in 0.831s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9baff7-24e1-46cb-9c16-85b5e995471a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:28 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 1G Jul 06 10:20:28 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:28 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 Jul 06 10:20:28 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:29 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431" returned: 0 in 0.803s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c33328a-377f-4cb9-b60c-4d4003554d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6c46df-4ad3-4e9a-a92d-f000748e1819]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:29 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 1G" returned: 0 in 0.866s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cee604f-8464-4112-b014-d0af8f8d31df -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:29 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cee604f-8464-4112-b014-d0af8f8d31df -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 Jul 06 10:20:29 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:29 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 Jul 06 10:20:29 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:29 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99" returned: 0 in 0.733s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:29 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cee604f-8464-4112-b014-d0af8f8d31df -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4" returned: 0 in 0.725s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:29 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 is being set with open permissions: ugo+rw Jul 06 10:20:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:29 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 Jul 06 10:20:29 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:29 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 Jul 06 10:20:29 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:30 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4" returned: 0 in 0.724s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:30 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.info Jul 06 10:20:30 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:30 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431" returned: 0 in 0.849s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:30 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431 Jul 06 10:20:30 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:31 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.info" returned: 0 in 0.692s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:31 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.info is being set with open permissions: ugo+rw Jul 06 10:20:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:31 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99.a30d9fb8-a11b-4b00-b55c-c24e50f33431" returned: 0 in 0.652s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:31 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.info Jul 06 10:20:31 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-a30d9fb8-a11b-4b00-b55c-c24e50f33431" released by "_delete_snapshot" :: held 3.164s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-0c33328a-377f-4cb9-b60c-4d4003554d99" released by "delete_snapshot" :: held 3.189s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:31 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['19ee9264-94c7-46a7-a127-95b3a01b08c9', 'd1096cc0-d0e5-4148-a9f5-51715613c877', 'fb22e4aa-8390-4ea0-b030-e316ec9f6bad', 'b6bd7410-0d5b-447d-9d9d-9a84bf9a163e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Delete snapshot completed successfully. Jul 06 10:20:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-373617ff-576c-4536-8e97-267ad8d3f92f tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-a30d9fb8-a11b-4b00-b55c-c24e50f33431-delete_snapshot" released by "delete_snapshot" :: held 3.386s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:32 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.info" returned: 0 in 0.732s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.693s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4cb94a65-b32d-4a0f-b430-e1c2b2aaac84 tempest-VolumesExtendTest-1928057171 None] Create snapshot completed successfully Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b975a-9f77-43ee-8a83-5839b8b7207d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:32 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df Jul 06 10:20:32 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (181a11a9-c29e-4f07-b516-8dd66b8cff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533c6439-ef8d-4294-ba81-7a2cf7319694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533c6439-ef8d-4294-ba81-7a2cf7319694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1785128116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b480b1ca-131a-45f8-b514-c176c9308c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:33Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b720220-569a-4ea5-a64e-d4e81550aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b720220-569a-4ea5-a64e-d4e81550aa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402cd583-f381-41bc-b920-f2ff5c484ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402cd583-f381-41bc-b920-f2ff5c484ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b480b1ca-131a-45f8-b514-c176c9308c66', 'volume_name': 'volume-b480b1ca-131a-45f8-b514-c176c9308c66', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c7fe5-6b5f-416b-b88a-076dc55398a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c7fe5-6b5f-416b-b88a-076dc55398a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee15c2f-63ba-417c-ba0f-c11f5adb9a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:33 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Volume b480b1ca-131a-45f8-b514-c176c9308c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b480b1ca-131a-45f8-b514-c176c9308c66', 'volume_size': 1} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:33 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df" returned: 0 in 0.777s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 2G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 2G" returned: 0 in 0.127s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.939s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1785128116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b480b1ca-131a-45f8-b514-c176c9308c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:33Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Creating volume b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:33 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:33 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 1073741824 Jul 06 10:20:33 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:33 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cacad772-c550-4878-8da6-669faa4402fb tempest-VolumesExtendTest-1928057171 None] Extend volume completed successfully. Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "cinder-63b6bbba-3fc1-4b41-9f30-9812da256ea4-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Lock "cinder-63b6bbba-3fc1-4b41-9f30-9812da256ea4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "cinder-quobyte-1cee604f-8464-4112-b014-d0af8f8d31df" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-1cee604f-8464-4112-b014-d0af8f8d31df" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Acquiring lock "cinder-quobyte-63b6bbba-3fc1-4b41-9f30-9812da256ea4" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-63b6bbba-3fc1-4b41-9f30-9812da256ea4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Deleting offline snapshot 63b6bbba-3fc1-4b41-9f30-9812da256ea4 of volume 1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] snapshot_file for this snap is: volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a27f8e7-556c-450a-9256-371cdc9d944f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:33 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 Jul 06 10:20:33 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:34 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 1073741824" returned: 0 in 0.886s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:34 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 Jul 06 10:20:34 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:34 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4" returned: 0 in 0.751s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cee604f-8464-4112-b014-d0af8f8d31df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7747110e-021b-47f3-9471-99bda3dc7a74]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:34 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df Jul 06 10:20:34 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:34 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66" returned: 0 in 0.622s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee15c2f-63ba-417c-ba0f-c11f5adb9a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b480b1ca-131a-45f8-b514-c176c9308c66', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8a4ade-7f28-4e1b-9cda-e5c5d1ba5c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Volume volume-b480b1ca-131a-45f8-b514-c176c9308c66 (b480b1ca-131a-45f8-b514-c176c9308c66): created successfully Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8a4ade-7f28-4e1b-9cda-e5c5d1ba5c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (181a11a9-c29e-4f07-b516-8dd66b8cff36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b3e3b189-4fae-44bf-a303-2c6fbcdb239b tempest-VolumesSnapshotTestJSON-2039416257 None] Created volume successfully. Jul 06 10:20:35 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df" returned: 0 in 0.752s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:35 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 Jul 06 10:20:35 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:36 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4" returned: 0 in 0.754s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:36 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4 Jul 06 10:20:36 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Creating offline snapshot ac0389d0-5b59-4cf6-be0d-47618a691beb of volume b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6981dd2-8ec3-43f4-85dd-d03ef5db0390]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:36 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 Jul 06 10:20:36 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:36 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df.63b6bbba-3fc1-4b41-9f30-9812da256ea4" returned: 0 in 0.650s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-63b6bbba-3fc1-4b41-9f30-9812da256ea4" released by "_delete_snapshot" :: held 3.011s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-1cee604f-8464-4112-b014-d0af8f8d31df" released by "delete_snapshot" :: held 3.038s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Created reservations ['8889ea88-8206-434a-80db-2d9e9e544662', 'e32b5c33-8969-4ea2-89df-8a0a35a0cbc9', '7e1b0499-cffa-4896-9ece-01c208d8733d', 'fa48dc69-7795-4bed-9386-9b1298aff804'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Delete snapshot completed successfully. Jul 06 10:20:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79da801c-6369-4566-95c0-b1321197f5f4 tempest-VolumesExtendTest-1928057171 None] Lock "cinder-63b6bbba-3fc1-4b41-9f30-9812da256ea4-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:37 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66" returned: 0 in 0.790s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:37 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb 1G Jul 06 10:20:37 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:37 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb 1G" returned: 0 in 0.770s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b480b1ca-131a-45f8-b514-c176c9308c66 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:37 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b480b1ca-131a-45f8-b514-c176c9308c66 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb Jul 06 10:20:37 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Acquiring lock "cinder-1cee604f-8464-4112-b014-d0af8f8d31df-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Lock "cinder-1cee604f-8464-4112-b014-d0af8f8d31df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Acquiring lock "cinder-quobyte-1cee604f-8464-4112-b014-d0af8f8d31df" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-1cee604f-8464-4112-b014-d0af8f8d31df" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a91d15-153e-4730-8512-412410a34723]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:38 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df Jul 06 10:20:38 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:38 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b480b1ca-131a-45f8-b514-c176c9308c66 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb" returned: 0 in 0.683s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:38 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb is being set with open permissions: ugo+rw Jul 06 10:20:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:38 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb Jul 06 10:20:38 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:38 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df" returned: 0 in 0.738s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:38 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df Jul 06 10:20:38 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:39 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb" returned: 0 in 0.616s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:39 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.info Jul 06 10:20:39 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:39 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1cee604f-8464-4112-b014-d0af8f8d31df" returned: 0 in 0.631s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Lock "cinder-quobyte-1cee604f-8464-4112-b014-d0af8f8d31df" released by "delete_volume" :: held 1.433s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Created reservations ['40c4321d-034a-4504-accb-be1478c0ecf1', '1c0a71f7-9122-4709-9ff1-a46fc238d841', '1422be76-cc0b-4b4a-b937-da161f3bb8be', 'c4d30eb0-f996-414e-b471-e591d5ab8dab'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:39 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:39 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:39 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.info" returned: 0 in 0.635s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:39 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.info is being set with open permissions: ugo+rw Jul 06 10:20:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:39 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.info Jul 06 10:20:39 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:40 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.662s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:40 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Deleted volume successfully. Jul 06 10:20:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dfe27283-9d35-41ec-950d-4dd72fd188dc tempest-VolumesExtendTest-1928057171 None] Lock "cinder-1cee604f-8464-4112-b014-d0af8f8d31df-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:40 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.info" returned: 0 in 0.640s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.228s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c305cd02-37db-4450-91a7-e3a7605dbb23 tempest-VolumesSnapshotTestJSON-2039416257 None] Create snapshot completed successfully Jul 06 10:20:41 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (08780f32-5c39-4552-a009-ba11b73e634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af2a567-4851-4115-8348-24c2597d869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af2a567-4851-4115-8348-24c2597d869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524194071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1320a9-20fe-4b9e-b1a2-e4a01b59f962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ac0389d0-5b59-4cf6-be0d-47618a691beb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:42Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3aba24-47c7-4f7b-a256-83fdb11763bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3aba24-47c7-4f7b-a256-83fdb11763bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d621d729-7b6a-40d2-b463-a07e8a4ad7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d621d729-7b6a-40d2-b463-a07e8a4ad7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc1320a9-20fe-4b9e-b1a2-e4a01b59f962', 'volume_name': 'volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962', 'volume_size': 2, 'snapshot_id': 'ac0389d0-5b59-4cf6-be0d-47618a691beb'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2612074b-2236-4f8b-9c1e-ed32de322254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2612074b-2236-4f8b-9c1e-ed32de322254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dee0e3-420c-4b63-96dc-82cb23b9ebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:42 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume bc1320a9-20fe-4b9e-b1a2-e4a01b59f962: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962', 'volume_size': 2, 'snapshot_id': 'ac0389d0-5b59-4cf6-be0d-47618a691beb'} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-ac0389d0-5b59-4cf6-be0d-47618a691beb-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-ac0389d0-5b59-4cf6-be0d-47618a691beb-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Creating volume bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 from snapshot ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] snapshot: ac0389d0-5b59-4cf6-be0d-47618a691beb, volume: bc1320a9-20fe-4b9e-b1a2-e4a01b59f962, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead64b4e-64b4-4002-98f2-1f44430c777c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:42 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb Jul 06 10:20:42 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:43 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb" returned: 0 in 0.828s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b480b1ca-131a-45f8-b514-c176c9308c66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[630edbd5-40bf-404c-9722-3837d3308cf7]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:43 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 Jul 06 10:20:43 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:43 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66" returned: 0 in 0.800s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:20:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:43 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 Jul 06 10:20:43 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:47 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=127,cinder:SELECT=99,cinder:INSERT=40,cinder:DELETE=8 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=119,cinder:SELECT=105,cinder:INSERT=29,cinder:DELETE=13 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Flow 'volume_create_manager' (f022ea39-d006-45c2-94a1-28940e230dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3f9cdf-9b03-4438-b2c5-309f9dc21b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3f9cdf-9b03-4438-b2c5-309f9dc21b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1332595217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b3a02e-53d6-46f7-aae3-d1053f268c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d080790f25664b14a16ec1932a21d10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:48Z,use_quota=True,user_id='af41462c983c48bdad51136101202628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6aaca1-b7c3-439b-aa05-8b692d312293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f6aaca1-b7c3-439b-aa05-8b692d312293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96c9c8b-aba3-47bf-9a4a-bec8ec3aa91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96c9c8b-aba3-47bf-9a4a-bec8ec3aa91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b3a02e-53d6-46f7-aae3-d1053f268c60', 'volume_name': 'volume-38b3a02e-53d6-46f7-aae3-d1053f268c60', 'volume_size': 2}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c4578b-0839-4994-9dc6-e98ac45399ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c4578b-0839-4994-9dc6-e98ac45399ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (becf5d7b-cdb7-4b29-bac9-31ec079651aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:48 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Volume 38b3a02e-53d6-46f7-aae3-d1053f268c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b3a02e-53d6-46f7-aae3-d1053f268c60', 'volume_size': 2} Jul 06 10:20:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:49 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" returned: 0 in 5.264s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:49 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb362ba1-7f8c-469f-a81f-ffe1c89d36f2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:49 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 Jul 06 10:20:49 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:50 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:20:50 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Converted 1024.00 MB image at 194.48 MB/s Jul 06 10:20:50 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 is being set with open permissions: ugo+rw Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:50 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 Jul 06 10:20:50 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:50 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" returned: 0 in 0.652s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" released by "_copy_volume_from_snapshot" :: held 8.576s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-ac0389d0-5b59-4cf6-be0d-47618a691beb-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" released by "_create_volume_from_snapshot" :: held 8.604s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.619s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.405s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1332595217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b3a02e-53d6-46f7-aae3-d1053f268c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d080790f25664b14a16ec1932a21d10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:20:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:20:48Z,use_quota=True,user_id='af41462c983c48bdad51136101202628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Creating volume 38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:20:50 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 2147483648 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:50 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 2147483648 Jul 06 10:20:50 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dee0e3-420c-4b63-96dc-82cb23b9ebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962', 'volume_size': 2, 'snapshot_id': 'ac0389d0-5b59-4cf6-be0d-47618a691beb'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d24880-3576-4cb0-abed-5a51b82faca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 (bc1320a9-20fe-4b9e-b1a2-e4a01b59f962): created successfully Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d24880-3576-4cb0-abed-5a51b82faca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (08780f32-5c39-4552-a009-ba11b73e634f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:50 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3c63fd93-2b7b-4be9-95d3-ee84b43cc701 tempest-VolumesSnapshotTestJSON-2039416257 None] Created volume successfully. Jul 06 10:20:51 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 2147483648" returned: 0 in 0.945s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:51 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 Jul 06 10:20:51 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dfbd28-3355-4927-b951-6b926661de8c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:52 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 Jul 06 10:20:52 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:52 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (becf5d7b-cdb7-4b29-bac9-31ec079651aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b3a02e-53d6-46f7-aae3-d1053f268c60', 'volume_size': 2}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9e30b7-453b-4dc5-86fc-9041f3862b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:20:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Volume volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 (38b3a02e-53d6-46f7-aae3-d1053f268c60): created successfully Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9e30b7-453b-4dc5-86fc-9041f3862b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Flow 'volume_create_manager' (f022ea39-d006-45c2-94a1-28940e230dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:20:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c4004fb1-e57d-422f-b85e-87c9cae4a208 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Created volume successfully. Jul 06 10:20:52 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" returned: 0 in 0.791s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:52 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962 Jul 06 10:20:52 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Creating offline snapshot 2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 of volume 38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd304aa8-b719-4491-b1a9-db0d4f8a6dcd]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:53 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" returned: 0 in 0.720s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962" released by "delete_volume" :: held 1.559s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:53 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 Jul 06 10:20:53 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['e2c336ac-3b12-43fb-8f84-d318caed2ee3', 'b5b09bba-2152-4085-aaaa-f6ef178b0a0c', 'b2604b18-1eeb-4927-957f-a4accecf6bfd', '3d2c24bf-ade2-4eb8-9172-134617948012'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:53 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:53 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-ac0389d0-5b59-4cf6-be0d-47618a691beb-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-ac0389d0-5b59-4cf6-be0d-47618a691beb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-b480b1ca-131a-45f8-b514-c176c9308c66" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-b480b1ca-131a-45f8-b514-c176c9308c66" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-ac0389d0-5b59-4cf6-be0d-47618a691beb" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-ac0389d0-5b59-4cf6-be0d-47618a691beb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Deleting offline snapshot ac0389d0-5b59-4cf6-be0d-47618a691beb of volume b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] snapshot_file for this snap is: volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6d5eb2-30fa-4f4e-b064-936ca489e00e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:54 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60" returned: 0 in 0.863s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 2G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:54 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 2G Jul 06 10:20:54 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:54 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.706s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:54 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Deleted volume successfully. Jul 06 10:20:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3f005063-b03b-41ff-837c-153494306b9a tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-bc1320a9-20fe-4b9e-b1a2-e4a01b59f962-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:54 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb Jul 06 10:20:54 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:55 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:55 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb" returned: 0 in 0.843s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b480b1ca-131a-45f8-b514-c176c9308c66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 2G" returned: 0 in 0.829s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e497b0ea-7d6a-4099-9706-5d34ed086322]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:55 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 Jul 06 10:20:55 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:55 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 Jul 06 10:20:55 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:55 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" returned: 0 in 0.690s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:55 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 is being set with open permissions: ugo+rw Jul 06 10:20:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:55 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 Jul 06 10:20:55 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:56 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66" returned: 0 in 0.805s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:56 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb Jul 06 10:20:56 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:56 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" returned: 0 in 0.683s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:56 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.info Jul 06 10:20:56 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:56 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb" returned: 0 in 0.774s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:56 devstack sudo[99706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb Jul 06 10:20:56 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:57 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.info" returned: 0 in 0.706s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:57 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.info is being set with open permissions: ugo+rw Jul 06 10:20:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:57 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.info Jul 06 10:20:57 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:57 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66.ac0389d0-5b59-4cf6-be0d-47618a691beb" returned: 0 in 0.684s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-ac0389d0-5b59-4cf6-be0d-47618a691beb" released by "_delete_snapshot" :: held 3.229s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-b480b1ca-131a-45f8-b514-c176c9308c66" released by "delete_snapshot" :: held 3.257s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:57 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['0285c60d-d26c-404d-8d79-553bc72326a0', '1a2e0eeb-d21c-4b24-af85-0ea6ccc34a8b', 'c02c9d9d-d7d4-4ece-af14-5f28c4f32419', '49389455-e6bc-425b-a373-2f314d1e48a9'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:20:57 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Delete snapshot completed successfully. Jul 06 10:20:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d83c09d7-3db5-43db-b6fc-db37fb7eeeaf tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-ac0389d0-5b59-4cf6-be0d-47618a691beb-delete_snapshot" released by "delete_snapshot" :: held 3.433s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:20:58 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.info" returned: 0 in 0.725s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.594s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bcc8bde3-86df-4460-a531-ec3bdc3d6165 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Create snapshot completed successfully Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-b480b1ca-131a-45f8-b514-c176c9308c66-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-b480b1ca-131a-45f8-b514-c176c9308c66-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-b480b1ca-131a-45f8-b514-c176c9308c66" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-b480b1ca-131a-45f8-b514-c176c9308c66" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[12723ae6-c4bb-4b7d-9e1d-9cd0c8f21c21]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:58 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 Jul 06 10:20:58 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "cinder-2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "cinder-quobyte-38b3a02e-53d6-46f7-aae3-d1053f268c60" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-quobyte-38b3a02e-53d6-46f7-aae3-d1053f268c60" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "cinder-quobyte-2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-quobyte-2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Deleting offline snapshot 2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 of volume 38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] snapshot_file for this snap is: volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[be69fba0-d54d-4efe-80ca-592ae47bfc30]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:20:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:58 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:20:58 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:59 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 Jul 06 10:20:59 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:59 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66" returned: 0 in 0.837s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:59 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66 Jul 06 10:20:59 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:20:59 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.796s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:20:59 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" returned: 0 in 0.905s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b3a02e-53d6-46f7-aae3-d1053f268c60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d4c11-9b14-46d5-ba1a-8d29f46d5523]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:20:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:20:59 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 Jul 06 10:20:59 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:00 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b480b1ca-131a-45f8-b514-c176c9308c66" returned: 0 in 0.736s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-b480b1ca-131a-45f8-b514-c176c9308c66" released by "delete_volume" :: held 1.656s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['cc32f770-3d7f-46a7-930c-89d13c4d2e08', 'dde06afa-ac4c-4a7f-a06c-235eaafdd8f1', '30d6eb4b-1a5a-4db9-8fe9-7b7829270ca3', 'e9d5e78c-df06-40a4-9b5a-c36d62fa34e9'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:00 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:21:00 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:00 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60" returned: 0 in 0.856s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:00 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 Jul 06 10:21:00 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:01 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:21:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Deleted volume successfully. Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-de52c201-5077-4cb9-9b6e-3ca9ae7489fc tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-b480b1ca-131a-45f8-b514-c176c9308c66-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (be37de4c-c7a1-4027-a82f-e467c113119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e694da79-d983-4422-90ea-fa92dc505227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e694da79-d983-4422-90ea-fa92dc505227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1110536234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1037b503-901d-4459-9e9f-c4ec9ca7571d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:21:01Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c50ad1-3f0f-42fe-98a0-ec47ceb13e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c50ad1-3f0f-42fe-98a0-ec47ceb13e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f257098e-6030-449b-9ab1-1d22eb9f66b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f257098e-6030-449b-9ab1-1d22eb9f66b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1037b503-901d-4459-9e9f-c4ec9ca7571d', 'volume_name': 'volume-1037b503-901d-4459-9e9f-c4ec9ca7571d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1943fe0-587c-447b-bceb-87a5cce40627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1943fe0-587c-447b-bceb-87a5cce40627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10be1be-41ae-4abb-b95e-042a113995b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume 1037b503-901d-4459-9e9f-c4ec9ca7571d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1037b503-901d-4459-9e9f-c4ec9ca7571d', 'volume_size': 1} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1110536234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1037b503-901d-4459-9e9f-c4ec9ca7571d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:21:01Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Creating volume 1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:21:01 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:01 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d 1073741824 Jul 06 10:21:01 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:01 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" returned: 0 in 0.835s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:01 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12 Jul 06 10:21:01 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:02 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60.2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" returned: 0 in 0.670s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-quobyte-2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12" released by "_delete_snapshot" :: held 3.395s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-quobyte-38b3a02e-53d6-46f7-aae3-d1053f268c60" released by "delete_snapshot" :: held 3.421s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:02 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Created reservations ['9016ab7e-dee7-4460-9fe0-cfbdbf118470', 'c60e8148-a884-4e5e-ae61-e112b057db6b', '8684c837-4426-46d6-a331-e17dcc8c41b3', '2a72721d-22b1-4418-a232-1a6a2c6cdb6c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:21:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Delete snapshot completed successfully. Jul 06 10:21:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-632b6b42-6ef6-4379-9f29-af7f9b525f9c tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-2cdfb5e8-3a86-468e-a8ed-9dbf6ccf7b12-delete_snapshot" released by "delete_snapshot" :: held 3.560s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:02 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d 1073741824" returned: 0 in 0.897s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:02 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d Jul 06 10:21:02 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:03 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d" returned: 0 in 0.625s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10be1be-41ae-4abb-b95e-042a113995b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1037b503-901d-4459-9e9f-c4ec9ca7571d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4a48a9-8041-4794-be59-1f37aa5e543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume volume-1037b503-901d-4459-9e9f-c4ec9ca7571d (1037b503-901d-4459-9e9f-c4ec9ca7571d): created successfully Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f4a48a9-8041-4794-be59-1f37aa5e543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (be37de4c-c7a1-4027-a82f-e467c113119b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:21:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0799c92f-85e9-4377-a63b-a0f619fb59d0 tempest-VolumesSnapshotTestJSON-2039416257 None] Created volume successfully. Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "cinder-38b3a02e-53d6-46f7-aae3-d1053f268c60-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-38b3a02e-53d6-46f7-aae3-d1053f268c60-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "cinder-quobyte-38b3a02e-53d6-46f7-aae3-d1053f268c60" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-quobyte-38b3a02e-53d6-46f7-aae3-d1053f268c60" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e3d9c4-dc88-436f-8fc6-ed4ab775025b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:03 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 Jul 06 10:21:03 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Creating offline snapshot def8e004-fbcc-4e10-b6b0-6b59020828e8 of volume 1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9cc93f-13ac-4a1b-9924-9ad09d088415]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:03 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d Jul 06 10:21:03 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:04 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60" returned: 0 in 0.779s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:04 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60 Jul 06 10:21:04 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:04 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d" returned: 0 in 0.808s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:04 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 1G Jul 06 10:21:04 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:04 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-38b3a02e-53d6-46f7-aae3-d1053f268c60" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-quobyte-38b3a02e-53d6-46f7-aae3-d1053f268c60" released by "delete_volume" :: held 1.598s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Created reservations ['410e965c-b573-4a07-bd54-15b372eabf39', 'd38d90fd-2431-4691-b216-b756444cefa3', 'e75a9986-ea72-4abe-b446-bfa97f91b865', '9d45c4ef-cc06-4d37-bbda-297b82f6a594'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:04 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:21:04 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:05 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 1G" returned: 0 in 0.859s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1037b503-901d-4459-9e9f-c4ec9ca7571d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:05 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1037b503-901d-4459-9e9f-c4ec9ca7571d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 Jul 06 10:21:05 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:05 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.664s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:05 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:21:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Deleted volume successfully. Jul 06 10:21:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b6dcf61-01b3-49b6-bf21-d2a00cfffee2 tempest-VolumesSnapshotNegativeTestJSON-1767839185 None] Lock "cinder-38b3a02e-53d6-46f7-aae3-d1053f268c60-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:06 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1037b503-901d-4459-9e9f-c4ec9ca7571d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8" returned: 0 in 0.748s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:06 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 is being set with open permissions: ugo+rw Jul 06 10:21:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:06 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 Jul 06 10:21:06 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:06 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8" returned: 0 in 0.704s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:06 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.info Jul 06 10:21:06 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:07 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.info" returned: 0 in 0.643s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:07 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.info is being set with open permissions: ugo+rw Jul 06 10:21:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:07 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.info Jul 06 10:21:07 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:08 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.info" returned: 0 in 0.698s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.568s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-97b39d06-30f5-4227-8387-2835f304b88c tempest-VolumesSnapshotTestJSON-2039416257 None] Create snapshot completed successfully Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (06fe8533-cf16-4198-bd67-aa810479f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720a5eb4-c032-401e-9293-99a585a77636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720a5eb4-c032-401e-9293-99a585a77636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1873211821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c397e67-b16b-4b72-a6c5-6976088f209e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e64067292e964368a4a3aaa66db78d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=def8e004-fbcc-4e10-b6b0-6b59020828e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:21:09Z,use_quota=True,user_id='70bffe1aa1324cf5819ef63eb4f33222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18bbc9e-7f09-448d-871b-5be91ddf2b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18bbc9e-7f09-448d-871b-5be91ddf2b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94537db-b5c3-4edc-a71a-25366eaf4231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94537db-b5c3-4edc-a71a-25366eaf4231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7c397e67-b16b-4b72-a6c5-6976088f209e', 'volume_name': 'volume-7c397e67-b16b-4b72-a6c5-6976088f209e', 'volume_size': 1, 'snapshot_id': 'def8e004-fbcc-4e10-b6b0-6b59020828e8'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b672945b-694c-4b0c-bc1b-ae578ef2a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b672945b-694c-4b0c-bc1b-ae578ef2a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1f8630-e31e-4498-acaa-2e1e876e343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:09 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume 7c397e67-b16b-4b72-a6c5-6976088f209e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7c397e67-b16b-4b72-a6c5-6976088f209e', 'volume_size': 1, 'snapshot_id': 'def8e004-fbcc-4e10-b6b0-6b59020828e8'} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-def8e004-fbcc-4e10-b6b0-6b59020828e8-7c397e67-b16b-4b72-a6c5-6976088f209e" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-def8e004-fbcc-4e10-b6b0-6b59020828e8-7c397e67-b16b-4b72-a6c5-6976088f209e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Creating volume 7c397e67-b16b-4b72-a6c5-6976088f209e from snapshot def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-7c397e67-b16b-4b72-a6c5-6976088f209e" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-7c397e67-b16b-4b72-a6c5-6976088f209e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] snapshot: def8e004-fbcc-4e10-b6b0-6b59020828e8, volume: 7c397e67-b16b-4b72-a6c5-6976088f209e, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e99a0d3-8588-4fbd-8f5b-bfb82eaca739]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:09 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 Jul 06 10:21:09 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:10 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8" returned: 0 in 0.859s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1037b503-901d-4459-9e9f-c4ec9ca7571d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:21:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:21:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:21:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[45309c4e-0d85-4cb7-b694-485ade121805]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:10 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d Jul 06 10:21:10 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:11 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d" returned: 0 in 0.824s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:11 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:21:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:11 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e Jul 06 10:21:11 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:17 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e" returned: 0 in 5.528s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[226349cb-8561-4ab6-9bb5-35f1f7b1e107]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:17 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d Jul 06 10:21:17 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:17 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d" returned: 0 in 0.992s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:21:18 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Converted 1024.00 MB image at 185.21 MB/s Jul 06 10:21:18 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e is being set with open permissions: ugo+rw Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:18 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e Jul 06 10:21:18 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:18 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e" returned: 0 in 0.684s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-7c397e67-b16b-4b72-a6c5-6976088f209e" released by "_copy_volume_from_snapshot" :: held 9.026s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-def8e004-fbcc-4e10-b6b0-6b59020828e8-7c397e67-b16b-4b72-a6c5-6976088f209e" released by "_create_volume_from_snapshot" :: held 9.057s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.074s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1f8630-e31e-4498-acaa-2e1e876e343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c397e67-b16b-4b72-a6c5-6976088f209e', 'volume_size': 1, 'snapshot_id': 'def8e004-fbcc-4e10-b6b0-6b59020828e8'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de93edee-abf2-417f-bedc-6b3a391b5e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:18 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Volume volume-7c397e67-b16b-4b72-a6c5-6976088f209e (7c397e67-b16b-4b72-a6c5-6976088f209e): created successfully Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de93edee-abf2-417f-bedc-6b3a391b5e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Flow 'volume_create_manager' (06fe8533-cf16-4198-bd67-aa810479f81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:21:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-58287c7c-d711-4eb1-9d32-6fb109284694 tempest-VolumesSnapshotTestJSON-2039416257 None] Created volume successfully. Jul 06 10:21:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-7c397e67-b16b-4b72-a6c5-6976088f209e-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-7c397e67-b16b-4b72-a6c5-6976088f209e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-7c397e67-b16b-4b72-a6c5-6976088f209e" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-7c397e67-b16b-4b72-a6c5-6976088f209e" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:19 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fe51d2-1662-4e9a-a73c-81b0702fee4d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:19 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e Jul 06 10:21:19 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:20 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e" returned: 0 in 0.933s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:20 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e Jul 06 10:21:20 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:21 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-7c397e67-b16b-4b72-a6c5-6976088f209e" returned: 0 in 0.700s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-7c397e67-b16b-4b72-a6c5-6976088f209e" released by "delete_volume" :: held 1.717s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['d74255a0-42c1-40b3-9da4-15972403594d', '7eacae68-7acb-4dfb-ba84-5904d8607b50', 'f5e00720-f46f-4699-b8e7-6fdf2b860785', '713f5b16-2d26-4193-9bc9-6784800a30b4'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:21 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:21:21 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-def8e004-fbcc-4e10-b6b0-6b59020828e8-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-def8e004-fbcc-4e10-b6b0-6b59020828e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-1037b503-901d-4459-9e9f-c4ec9ca7571d" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-1037b503-901d-4459-9e9f-c4ec9ca7571d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-def8e004-fbcc-4e10-b6b0-6b59020828e8" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-def8e004-fbcc-4e10-b6b0-6b59020828e8" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Deleting offline snapshot def8e004-fbcc-4e10-b6b0-6b59020828e8 of volume 1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] snapshot_file for this snap is: volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52d7da8-f784-4a5d-b7cc-0807d0acd682]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:22 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.707s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:21:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Deleted volume successfully. Jul 06 10:21:22 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 Jul 06 10:21:22 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed2f774a-ff63-4e1a-8fe7-92c8e6a68e38 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-7c397e67-b16b-4b72-a6c5-6976088f209e-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:23 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8" returned: 0 in 0.846s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1037b503-901d-4459-9e9f-c4ec9ca7571d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:21:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6602cc-7e73-4b8e-bfd8-c89afec8181d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:23 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d Jul 06 10:21:23 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:23 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d" returned: 0 in 0.880s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:24 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 Jul 06 10:21:24 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:24 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8" returned: 0 in 0.848s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:24 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8 Jul 06 10:21:24 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:25 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d.def8e004-fbcc-4e10-b6b0-6b59020828e8" returned: 0 in 0.723s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-def8e004-fbcc-4e10-b6b0-6b59020828e8" released by "_delete_snapshot" :: held 3.426s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-1037b503-901d-4459-9e9f-c4ec9ca7571d" released by "delete_snapshot" :: held 3.473s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:25 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['e86e4eec-a328-4c5c-b5ed-338794ab2983', 'd4f280a3-7e57-4f72-9c80-7560c2928192', '14b8c3e3-10a1-4b7a-910c-0d4cc22266c6', '65af6244-bb94-4a50-bb0e-973db59de29f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:21:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Delete snapshot completed successfully. Jul 06 10:21:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9a03c6eb-df8d-453c-a004-fb0eca4242ac tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-def8e004-fbcc-4e10-b6b0-6b59020828e8-delete_snapshot" released by "delete_snapshot" :: held 3.646s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-1037b503-901d-4459-9e9f-c4ec9ca7571d-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-1037b503-901d-4459-9e9f-c4ec9ca7571d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-1037b503-901d-4459-9e9f-c4ec9ca7571d" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-1037b503-901d-4459-9e9f-c4ec9ca7571d" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec1e3dc-92a0-4555-a63a-fdfd2a13307e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:26 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d Jul 06 10:21:26 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:27 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d" returned: 0 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:27 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d Jul 06 10:21:27 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:28 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1037b503-901d-4459-9e9f-c4ec9ca7571d" returned: 0 in 0.744s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-1037b503-901d-4459-9e9f-c4ec9ca7571d" released by "delete_volume" :: held 1.657s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['d5d33b63-1fa5-48cf-b250-d8197f39b75b', '50c6b5c3-eb80-4521-b720-3139873babe6', '34cf5c1e-c5e8-445b-9f5e-3592b2ae3c80', 'ae7a0755-a1f4-4f57-9199-bebbb84465fb'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:28 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:21:28 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-0c33328a-377f-4cb9-b60c-4d4003554d99-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-0c33328a-377f-4cb9-b60c-4d4003554d99-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "cinder-quobyte-0c33328a-377f-4cb9-b60c-4d4003554d99" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:21:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-0c33328a-377f-4cb9-b60c-4d4003554d99" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:21:29 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5b8f7-50c9-4c45-8ee2-3fcbcee0f47a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:29 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 Jul 06 10:21:29 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:29 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.871s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:29 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:21:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Deleted volume successfully. Jul 06 10:21:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ad53b2a8-e8ae-4d2c-96e5-247f095b5aeb tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-1037b503-901d-4459-9e9f-c4ec9ca7571d-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:29 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99" returned: 0 in 0.960s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:30 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99 Jul 06 10:21:30 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:30 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0c33328a-377f-4cb9-b60c-4d4003554d99" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-quobyte-0c33328a-377f-4cb9-b60c-4d4003554d99" released by "delete_volume" :: held 1.870s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:30 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Created reservations ['d8af920d-32d1-462d-8e27-64ace1fbbd45', '67bd212b-c0b2-4464-ac30-de04cfa8f37b', 'f25678a6-49c2-4f29-9185-015c7d7c3cf5', 'adf94e9b-f0ce-4c73-95c3-140c02f281b1'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:31 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:21:31 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:31 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.726s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:21:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Deleted volume successfully. Jul 06 10:21:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-dd6224c6-27a0-4663-a90a-eff94b919db6 tempest-VolumesSnapshotTestJSON-2039416257 None] Lock "cinder-0c33328a-377f-4cb9-b60c-4d4003554d99-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Flow 'volume_create_manager' (7bdfb95b-509a-4431-bf63-1b5483afad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e190d0a-5ffe-4c4b-b9e1-42ed69fa9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e190d0a-5ffe-4c4b-b9e1-42ed69fa9e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2033014096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34707bf8-7783-4bff-8e07-6237d95e7076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3729faae7491a9ebfa4265990ebfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:21:35Z,use_quota=True,user_id='a2d979097e6342868672c75520686b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5d414d-22fb-4ab3-8d9a-72e3715c935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e5d414d-22fb-4ab3-8d9a-72e3715c935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87032a68-2a17-4215-8b06-e25bb92058c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87032a68-2a17-4215-8b06-e25bb92058c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34707bf8-7783-4bff-8e07-6237d95e7076', 'volume_name': 'volume-34707bf8-7783-4bff-8e07-6237d95e7076', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d456378-93c1-4005-bd39-b53ab50b8e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d456378-93c1-4005-bd39-b53ab50b8e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920620aa-fe35-4282-a946-2ce363dab572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:35 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Volume 34707bf8-7783-4bff-8e07-6237d95e7076: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34707bf8-7783-4bff-8e07-6237d95e7076', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 10:21:35 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Trying to clone 34707bf8-7783-4bff-8e07-6237d95e7076 from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 at location (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:21:36 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:21:36 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Image download 20.69 MB at 20.69 MB/s Jul 06 10:21:36 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2724aa7b-43e6-415d-ad6c-ede0af5b3ee6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:36 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD Jul 06 10:21:36 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:37 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 is fetched for user a2d979097e6342868672c75520686b8a. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bedecf-d963-4bcc-8d40-c9a76760e406]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:37 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD Jul 06 10:21:37 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:37 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD" returned: 0 in 0.708s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2033014096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34707bf8-7783-4bff-8e07-6237d95e7076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca3729faae7491a9ebfa4265990ebfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:21:35Z,use_quota=True,user_id='a2d979097e6342868672c75520686b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Creating volume 34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:21:37 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:21:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:37 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 1073741824 Jul 06 10:21:37 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:38 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 1073741824" returned: 0 in 1.019s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:38 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:21:38 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:39 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 0 in 0.696s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:21:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:39 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Attempting download of 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume 34707bf8-7783-4bff-8e07-6237d95e7076. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:21:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b0877-4402-432d-bcda-79f088cd4e58]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_7jwvo14a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:39 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_7jwvo14a Jul 06 10:21:39 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:40 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_7jwvo14a" returned: 0 in 0.789s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_7jwvo14a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:40 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_7jwvo14a Jul 06 10:21:40 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:41 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_7jwvo14a" returned: 1 in 0.772s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_58ff08d4-fcf7-43ec-b9cb-ad129e740264_7jwvo14a' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:21:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3eb5a9-d956-454c-b4a5-489ed5d34b70]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:41 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD Jul 06 10:21:41 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:42 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD" returned: 0 in 0.810s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:42 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] 58ff08d4-fcf7-43ec-b9cb-ad129e740264 was qcow2, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:21:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:42 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:21:42 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:44 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 0 in 2.170s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:44 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_58ff08d4-fcf7-43ec-b9cb-ad129e740264_mdjsze_0devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:21:44 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Converted 112.00 MB image at 51.57 MB/s Jul 06 10:21:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:44 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 1G Jul 06 10:21:44 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:45 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 1G" returned: 0 in 0.778s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:45 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcd8d7e-13f6-49d6-84ed-ca5b97d1c61f]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:45 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:21:45 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:45 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 0 in 0.832s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:46 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:21:46 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:46 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 1 in 0.774s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Downloaded image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 ((None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}])) to volume 34707bf8-7783-4bff-8e07-6237d95e7076 successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Temporary image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 for user a2d979097e6342868672c75520686b8a is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Marking volume 34707bf8-7783-4bff-8e07-6237d95e7076 as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Copying metadata from image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 to 34707bf8-7783-4bff-8e07-6237d95e7076. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Creating volume glance metadata for volume 34707bf8-7783-4bff-8e07-6237d95e7076 backed by image 58ff08d4-fcf7-43ec-b9cb-ad129e740264 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920620aa-fe35-4282-a946-2ce363dab572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34707bf8-7783-4bff-8e07-6237d95e7076', 'volume_size': 1, 'image_id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9d895e90230c497881c4d9f50d5ae868', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '58ff08d4-fcf7-43ec-b9cb-ad129e740264', 'created_at': datetime.datetime(2026, 7, 6, 7, 58, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 7, 58, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/58ff08d4-fcf7-43ec-b9cb-ad129e740264/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f41883-6748-4467-b445-0aebd20a20cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:21:46 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Volume volume-34707bf8-7783-4bff-8e07-6237d95e7076 (34707bf8-7783-4bff-8e07-6237d95e7076): created successfully Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f41883-6748-4467-b445-0aebd20a20cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:21:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Flow 'volume_create_manager' (7bdfb95b-509a-4431-bf63-1b5483afad7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:21:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e7ff6527-1b9b-455a-b9ec-a60eaee97966 tempest-TestShelveInstance-1107085916 None] Created volume successfully. Jul 06 10:21:49 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=72,cinder:UPDATE=84,cinder:DELETE=4,cinder:INSERT=27 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:21:49 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=79,cinder:SELECT=68,cinder:INSERT=27,cinder:DELETE=9 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:21:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f58c4-75c0-4ea0-8fbc-3401179d47fa]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:21:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:55 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:21:55 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:55 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 0 in 0.856s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:56 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:21:56 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:56 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 1 in 0.881s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:21:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.799s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-34707bf8-7783-4bff-8e07-6237d95e7076', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cae5a301-3e12-46bb-a79e-0c5b5ffc7a74', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:21:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-5adc7f66-7531-4d1d-afd6-7e50b272b4e3 req-b6d81bb0-d524-4a6c-b309-5fbc8fcb29a5 tempest-TestShelveInstance-1107085916 None] attachment_update completed successfully. Jul 06 10:21:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:21:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:21:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:21:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:21:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:21:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:21:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:21:58 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:21:58 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:21:59 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 06 10:21:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.912s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:21:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:21:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:21:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:21:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Flow 'volume_create_manager' (2ea8d456-7753-4845-a74e-b4812c045a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad50a9f-a259-4965-bc15-08e8b781fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad50a9f-a259-4965-bc15-08e8b781fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1840556480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef97432-a6ee-4c9c-ba85-a790e2501ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a3f054272149858e1b2ee2b9ddd9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:22:04Z,use_quota=True,user_id='1078941445bb4b7f8cb5929027953e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed32c4c9-d1cd-418f-9ea4-5fcaee543719),volume_type_id=ed32c4c9-d1cd-418f-9ea4-5fcaee543719)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68c232f-0bb5-43b9-8edd-b9ca21c5d445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68c232f-0bb5-43b9-8edd-b9ca21c5d445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7becf045-a672-440d-aabb-846687a72a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7becf045-a672-440d-aabb-846687a72a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef97432-a6ee-4c9c-ba85-a790e2501ed1', 'volume_name': 'volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979345d4-b7c6-4e16-9ff3-7692dde474d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979345d4-b7c6-4e16-9ff3-7692dde474d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a012261-b65e-4cff-8276-75c68f70673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume 1ef97432-a6ee-4c9c-ba85-a790e2501ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1', 'volume_size': 1} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1840556480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef97432-a6ee-4c9c-ba85-a790e2501ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a3f054272149858e1b2ee2b9ddd9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:22:04Z,use_quota=True,user_id='1078941445bb4b7f8cb5929027953e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed32c4c9-d1cd-418f-9ea4-5fcaee543719),volume_type_id=ed32c4c9-d1cd-418f-9ea4-5fcaee543719)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Creating volume 1ef97432-a6ee-4c9c-ba85-a790e2501ed1 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:22:04 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:04 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 1073741824 Jul 06 10:22:04 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Flow 'volume_create_manager' (bc1603b3-7c42-4f4a-a6e7-b701b7fe867a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e962096-73fe-4a00-a292-af61013c3fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e962096-73fe-4a00-a292-af61013c3fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1215587013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b047495b-0528-45f4-8b27-46eb4d274561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a3f054272149858e1b2ee2b9ddd9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:22:04Z,use_quota=True,user_id='1078941445bb4b7f8cb5929027953e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53dd8d6c-db0a-4544-b66a-23c3b5b116a9),volume_type_id=53dd8d6c-db0a-4544-b66a-23c3b5b116a9)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab630e1d-e726-49e4-937a-1b3a316b7d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab630e1d-e726-49e4-937a-1b3a316b7d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b08fc3-bd5a-4232-b9d7-1295550c64fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b08fc3-bd5a-4232-b9d7-1295550c64fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b047495b-0528-45f4-8b27-46eb4d274561', 'volume_name': 'volume-b047495b-0528-45f4-8b27-46eb4d274561', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dd5789-d01e-4588-aa73-27a170421078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dd5789-d01e-4588-aa73-27a170421078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56526089-1bd6-43d8-922b-9a9ac86add29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume b047495b-0528-45f4-8b27-46eb4d274561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b047495b-0528-45f4-8b27-46eb4d274561', 'volume_size': 1} Jul 06 10:22:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:05 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 1073741824" returned: 0 in 1.057s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:05 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 Jul 06 10:22:05 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Flow 'volume_create_manager' (07830c7a-b4d6-4b99-943e-3f4cd8b8ae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc84e4f-d0b2-4c2e-bbc1-d1ddbb9b7f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc84e4f-d0b2-4c2e-bbc1-d1ddbb9b7f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2064558805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418bf251-7887-4e48-9c9e-5fe2b4df40ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a3f054272149858e1b2ee2b9ddd9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:22:05Z,use_quota=True,user_id='1078941445bb4b7f8cb5929027953e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1247997-de65-4c4c-baec-79b15cd06646),volume_type_id=c1247997-de65-4c4c-baec-79b15cd06646)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154ca008-bbba-4413-8d97-b0e29f15f918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154ca008-bbba-4413-8d97-b0e29f15f918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5ab53c-42dc-4d2c-9ac5-867cdeb0de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5ab53c-42dc-4d2c-9ac5-867cdeb0de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '418bf251-7887-4e48-9c9e-5fe2b4df40ed', 'volume_name': 'volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed', 'volume_size': 1, 'image_id': 'cba0aec5-fbec-4288-a4be-c7c108839ed7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cba0aec5-fbec-4288-a4be-c7c108839ed7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--683518934', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63a3f054272149858e1b2ee2b9ddd9ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cba0aec5-fbec-4288-a4be-c7c108839ed7', 'created_at': datetime.datetime(2026, 7, 6, 8, 22, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 22, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cba0aec5-fbec-4288-a4be-c7c108839ed7/file', 'properties': {}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e24b7a-f990-4eb9-8704-8338e7990142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e24b7a-f990-4eb9-8704-8338e7990142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5fa684-8254-4349-9d14-d0f36b5d705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume 418bf251-7887-4e48-9c9e-5fe2b4df40ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed', 'volume_size': 1, 'image_id': 'cba0aec5-fbec-4288-a4be-c7c108839ed7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cba0aec5-fbec-4288-a4be-c7c108839ed7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--683518934', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63a3f054272149858e1b2ee2b9ddd9ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cba0aec5-fbec-4288-a4be-c7c108839ed7', 'created_at': datetime.datetime(2026, 7, 6, 8, 22, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 22, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cba0aec5-fbec-4288-a4be-c7c108839ed7/file', 'properties': {}}, 'image_service': } Jul 06 10:22:05 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Trying to clone 418bf251-7887-4e48-9c9e-5fe2b4df40ed from image cba0aec5-fbec-4288-a4be-c7c108839ed7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cba0aec5-fbec-4288-a4be-c7c108839ed7', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:22:06 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1" returned: 0 in 1.040s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1215587013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b047495b-0528-45f4-8b27-46eb4d274561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a3f054272149858e1b2ee2b9ddd9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:22:04Z,use_quota=True,user_id='1078941445bb4b7f8cb5929027953e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53dd8d6c-db0a-4544-b66a-23c3b5b116a9),volume_type_id=53dd8d6c-db0a-4544-b66a-23c3b5b116a9)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Creating volume b047495b-0528-45f4-8b27-46eb4d274561 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:22:06 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:06 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 1073741824 Jul 06 10:22:06 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a012261-b65e-4cff-8276-75c68f70673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd858b34-8377-4f5f-938e-f86aa091b225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:06 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 (1ef97432-a6ee-4c9c-ba85-a790e2501ed1): created successfully Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd858b34-8377-4f5f-938e-f86aa091b225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Flow 'volume_create_manager' (2ea8d456-7753-4845-a74e-b4812c045a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:22:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ab4fc66f-a876-4c01-ba90-9c65a6e85f25 tempest-TestInstancesWithCinderVolumes-1909193101 None] Created volume successfully. Jul 06 10:22:07 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 1073741824" returned: 0 in 1.054s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:07 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 Jul 06 10:22:07 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:08 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561" returned: 0 in 0.847s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:22:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56526089-1bd6-43d8-922b-9a9ac86add29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b047495b-0528-45f4-8b27-46eb4d274561', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ed2fa8-ebcf-4557-8483-b331520d70ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:08 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume volume-b047495b-0528-45f4-8b27-46eb4d274561 (b047495b-0528-45f4-8b27-46eb4d274561): created successfully Jul 06 10:22:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ed2fa8-ebcf-4557-8483-b331520d70ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Flow 'volume_create_manager' (bc1603b3-7c42-4f4a-a6e7-b701b7fe867a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:22:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f4854664-6d81-4e22-9656-6463eb2fb79e tempest-TestInstancesWithCinderVolumes-1909193101 None] Created volume successfully. Jul 06 10:22:10 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD, size 20.69 MB, duration 4.20 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:22:10 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Image download 20.69 MB at 4.93 MB/s Jul 06 10:22:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f495972-19a5-4819-babb-a6758b86f1bb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:22:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:10 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD Jul 06 10:22:10 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:10 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD" returned: 0 in 0.735s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:10 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Temporary image cba0aec5-fbec-4288-a4be-c7c108839ed7 is fetched for user 1078941445bb4b7f8cb5929027953e7b. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:22:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d30b2e-36f0-4512-9ed8-657ffa712f7e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:22:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:11 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD Jul 06 10:22:11 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:11 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2064558805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418bf251-7887-4e48-9c9e-5fe2b4df40ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a3f054272149858e1b2ee2b9ddd9ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:22:05Z,use_quota=True,user_id='1078941445bb4b7f8cb5929027953e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1247997-de65-4c4c-baec-79b15cd06646),volume_type_id=c1247997-de65-4c4c-baec-79b15cd06646)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Creating volume 418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:22:11 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:22:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:11 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed 1073741824 Jul 06 10:22:11 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:12 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed 1073741824" returned: 0 in 0.857s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:12 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:22:12 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:13 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 0 in 0.702s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:22:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:13 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Attempting download of cba0aec5-fbec-4288-a4be-c7c108839ed7 ((None, [{'url': 'file:///opt/stack/data/glance/images/cba0aec5-fbec-4288-a4be-c7c108839ed7', 'metadata': {}}])) to volume 418bf251-7887-4e48-9c9e-5fe2b4df40ed. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:22:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b81728c-8e74-4cac-b755-6396e2f343b4]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:22:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cba0aec5-fbec-4288-a4be-c7c108839ed7_md_aq_qk {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:13 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cba0aec5-fbec-4288-a4be-c7c108839ed7_md_aq_qk Jul 06 10:22:13 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:14 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cba0aec5-fbec-4288-a4be-c7c108839ed7_md_aq_qk" returned: 0 in 0.766s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba0aec5-fbec-4288-a4be-c7c108839ed7_md_aq_qk {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:14 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba0aec5-fbec-4288-a4be-c7c108839ed7_md_aq_qk Jul 06 10:22:14 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:14 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba0aec5-fbec-4288-a4be-c7c108839ed7_md_aq_qk" returned: 1 in 0.783s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cba0aec5-fbec-4288-a4be-c7c108839ed7_md_aq_qk' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:22:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6445b4e-bd87-4f78-bf80-af116ae92646]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:22:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:15 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD Jul 06 10:22:15 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:15 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:15 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] cba0aec5-fbec-4288-a4be-c7c108839ed7 was qcow2, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:22:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:15 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:22:15 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:17 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 0 in 1.919s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:17 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cba0aec5-fbec-4288-a4be-c7c108839ed7_lxo8cjc_devstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:22:17 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Converted 112.00 MB image at 58.32 MB/s Jul 06 10:22:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:17 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed 1G Jul 06 10:22:17 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:18 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed 1G" returned: 0 in 0.710s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f946bc9-6937-4ede-bc53-de34a761d1e1]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:22:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:18 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:22:18 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:19 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 0 in 0.738s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:19 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:22:19 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:19 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 1 in 0.809s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Downloaded image cba0aec5-fbec-4288-a4be-c7c108839ed7 ((None, [{'url': 'file:///opt/stack/data/glance/images/cba0aec5-fbec-4288-a4be-c7c108839ed7', 'metadata': {}}])) to volume 418bf251-7887-4e48-9c9e-5fe2b4df40ed successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Temporary image cba0aec5-fbec-4288-a4be-c7c108839ed7 for user 1078941445bb4b7f8cb5929027953e7b is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Marking volume 418bf251-7887-4e48-9c9e-5fe2b4df40ed as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Copying metadata from image cba0aec5-fbec-4288-a4be-c7c108839ed7 to 418bf251-7887-4e48-9c9e-5fe2b4df40ed. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:22:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Creating volume glance metadata for volume 418bf251-7887-4e48-9c9e-5fe2b4df40ed backed by image cba0aec5-fbec-4288-a4be-c7c108839ed7 with: {'image_id': 'cba0aec5-fbec-4288-a4be-c7c108839ed7', 'image_name': 'tempest-scenario-img--683518934', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:22:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5fa684-8254-4349-9d14-d0f36b5d705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed', 'volume_size': 1, 'image_id': 'cba0aec5-fbec-4288-a4be-c7c108839ed7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cba0aec5-fbec-4288-a4be-c7c108839ed7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--683518934', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63a3f054272149858e1b2ee2b9ddd9ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cba0aec5-fbec-4288-a4be-c7c108839ed7', 'created_at': datetime.datetime(2026, 7, 6, 8, 22, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 22, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cba0aec5-fbec-4288-a4be-c7c108839ed7/file', 'properties': {}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9c34d3-ee3d-404d-bbbd-624669c38f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:22:20 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Volume volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed (418bf251-7887-4e48-9c9e-5fe2b4df40ed): created successfully Jul 06 10:22:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9c34d3-ee3d-404d-bbbd-624669c38f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:22:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Flow 'volume_create_manager' (07830c7a-b4d6-4b99-943e-3f4cd8b8ae45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:22:20 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-40e10410-855e-424e-839f-d2515b99c0f0 tempest-TestInstancesWithCinderVolumes-1909193101 None] Created volume successfully. Jul 06 10:22:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:27 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb8b915-a45e-4c41-8863-781555286eac]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:22:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:27 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:22:27 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:28 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 0 in 0.817s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:28 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:22:28 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:29 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 1 in 0.799s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:22:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.662s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd726cfa3-72d1-4623-b195-8ef3bf5c300a', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:22:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-c8d32c1d-7721-45ed-96c4-dd091845b8f0 req-ea2ef1fe-7610-4819-8466-66f296d665c9 tempest-TestInstancesWithCinderVolumes-1909193101 None] attachment_update completed successfully. Jul 06 10:22:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-a55532fa-bed9-4258-8246-c3ea569880df req-4db59a3c-9de7-4b7b-a3ac-262980559dab tempest-TestShelveInstance-1107085916 None] Terminate volume connection completed successfully. Jul 06 10:22:35 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-a55532fa-bed9-4258-8246-c3ea569880df req-4db59a3c-9de7-4b7b-a3ac-262980559dab tempest-TestShelveInstance-1107085916 None] Deleting attachment cae5a301-3e12-46bb-a79e-0c5b5ffc7a74. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:22:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[714fe937-3c21-42cc-a0f5-f8b5ffaa3f0a]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:22:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:41 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:22:41 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:42 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 0 in 0.914s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:42 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:22:42 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:43 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 1 in 0.812s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:22:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.775s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-34707bf8-7783-4bff-8e07-6237d95e7076', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbe5581b-ac0d-41d3-8ec8-2f89e444b6f4', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:22:43 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-18e1a842-c475-4fb5-93c8-5d826e51dceb req-0edba630-a330-438f-99c5-06f8f613c099 tempest-TestShelveInstance-1107085916 None] attachment_update completed successfully. Jul 06 10:22:53 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=28,cinder:UPDATE=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:22:53 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=30,cinder:UPDATE=18,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:22:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:22:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:22:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:22:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:22:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:22:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:22:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:22:59 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:22:59 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:22:59 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 06 10:22:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.749s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:22:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:22:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:22:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:22:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:23:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-e8a95656-5f29-468d-829c-cedafbf04d71 req-1cc1cad0-4132-4e80-9f7e-35f96e5aab33 tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-e8a95656-5f29-468d-829c-cedafbf04d71 req-1cc1cad0-4132-4e80-9f7e-35f96e5aab33 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:07 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a4e67-dfd2-4d87-bc12-ee0e7fbf2a9b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:23:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e8a95656-5f29-468d-829c-cedafbf04d71 req-1cc1cad0-4132-4e80-9f7e-35f96e5aab33 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:07 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 Jul 06 10:23:07 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:07 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-e8a95656-5f29-468d-829c-cedafbf04d71 req-1cc1cad0-4132-4e80-9f7e-35f96e5aab33 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1" returned: 0 in 0.750s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-e8a95656-5f29-468d-829c-cedafbf04d71 req-1cc1cad0-4132-4e80-9f7e-35f96e5aab33 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-e8a95656-5f29-468d-829c-cedafbf04d71 req-1cc1cad0-4132-4e80-9f7e-35f96e5aab33 tempest-TestInstancesWithCinderVolumes-1909193101 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd71f2e6b-227f-443b-a73c-30ea3e6d08de', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:23:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-e8a95656-5f29-468d-829c-cedafbf04d71 req-1cc1cad0-4132-4e80-9f7e-35f96e5aab33 tempest-TestInstancesWithCinderVolumes-1909193101 None] attachment_update completed successfully. Jul 06 10:23:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-aae54043-7e9a-4421-997f-ccb4b9251b02 req-6956c79c-54bf-4462-be73-7729e8fc46b2 tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-aae54043-7e9a-4421-997f-ccb4b9251b02 req-6956c79c-54bf-4462-be73-7729e8fc46b2 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:15 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e1f5f8-12fe-4ae9-a74e-8ae6660e4afc]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:23:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-aae54043-7e9a-4421-997f-ccb4b9251b02 req-6956c79c-54bf-4462-be73-7729e8fc46b2 tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:15 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 Jul 06 10:23:15 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:16 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-aae54043-7e9a-4421-997f-ccb4b9251b02 req-6956c79c-54bf-4462-be73-7729e8fc46b2 tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561" returned: 0 in 0.772s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-aae54043-7e9a-4421-997f-ccb4b9251b02 req-6956c79c-54bf-4462-be73-7729e8fc46b2 tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-aae54043-7e9a-4421-997f-ccb4b9251b02 req-6956c79c-54bf-4462-be73-7729e8fc46b2 tempest-TestInstancesWithCinderVolumes-1909193101 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-b047495b-0528-45f4-8b27-46eb4d274561', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc5c9706-ebbe-4af2-bfb1-df724ed89aef', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:23:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-aae54043-7e9a-4421-997f-ccb4b9251b02 req-6956c79c-54bf-4462-be73-7729e8fc46b2 tempest-TestInstancesWithCinderVolumes-1909193101 None] attachment_update completed successfully. Jul 06 10:23:24 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-0a6baed0-56d2-4367-9193-43dda1ec7c90 req-133717da-f36b-48b1-a106-1bb45190006c tempest-TestInstancesWithCinderVolumes-1909193101 None] Terminate volume connection completed successfully. Jul 06 10:23:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-0a6baed0-56d2-4367-9193-43dda1ec7c90 req-133717da-f36b-48b1-a106-1bb45190006c tempest-TestInstancesWithCinderVolumes-1909193101 None] Deleting attachment d71f2e6b-227f-443b-a73c-30ea3e6d08de. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:23:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "cinder-1ef97432-a6ee-4c9c-ba85-a790e2501ed1-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-1ef97432-a6ee-4c9c-ba85-a790e2501ed1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "cinder-quobyte-1ef97432-a6ee-4c9c-ba85-a790e2501ed1" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-quobyte-1ef97432-a6ee-4c9c-ba85-a790e2501ed1" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd6bfc0-80bf-4c0e-8aa4-a98069a72850]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:23:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:26 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 Jul 06 10:23:26 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:27 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1" returned: 0 in 0.760s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:27 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1 Jul 06 10:23:27 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:28 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1ef97432-a6ee-4c9c-ba85-a790e2501ed1" returned: 0 in 0.709s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-quobyte-1ef97432-a6ee-4c9c-ba85-a790e2501ed1" released by "delete_volume" :: held 1.510s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:28 devstack cinder-volume[86456]: WARNING cinder.quota [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1578694185-1794637976 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1578694185-1794637976, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:23:28 devstack cinder-volume[86456]: WARNING cinder.quota [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1578694185-1794637976 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1578694185-1794637976, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Created reservations ['5ee6028d-d71e-47d2-8672-2611d9cb0068', 'c9b7c44e-7b61-4d61-b85d-4bb0b9f51234', '391e27e8-ae9d-42f0-b16a-8e7c696cfe79', '28dc5b57-c0a5-467c-b3cc-d45611d8f534'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:28 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:23:28 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:29 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.681s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:29 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:23:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Deleted volume successfully. Jul 06 10:23:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f6b82a26-0f8a-48ad-ab5a-06871f9cbb8f tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-1ef97432-a6ee-4c9c-ba85-a790e2501ed1-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-99c6c72f-bc4e-44d8-bd31-a3332c341082 req-61757613-4b3c-4d84-9fe1-d4016fdeb5b7 tempest-TestInstancesWithCinderVolumes-1909193101 None] Terminate volume connection completed successfully. Jul 06 10:23:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-99c6c72f-bc4e-44d8-bd31-a3332c341082 req-61757613-4b3c-4d84-9fe1-d4016fdeb5b7 tempest-TestInstancesWithCinderVolumes-1909193101 None] Deleting attachment dc5c9706-ebbe-4af2-bfb1-df724ed89aef. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:23:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "cinder-b047495b-0528-45f4-8b27-46eb4d274561-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-b047495b-0528-45f4-8b27-46eb4d274561-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "cinder-quobyte-b047495b-0528-45f4-8b27-46eb4d274561" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-quobyte-b047495b-0528-45f4-8b27-46eb4d274561" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e62b170-30fc-4a50-9d02-cc718f9d7933]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:23:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:33 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 Jul 06 10:23:33 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:34 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561" returned: 0 in 0.880s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:34 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561 Jul 06 10:23:34 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b047495b-0528-45f4-8b27-46eb4d274561" returned: 0 in 0.771s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:34 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-quobyte-b047495b-0528-45f4-8b27-46eb4d274561" released by "delete_volume" :: held 1.720s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:34 devstack cinder-volume[86456]: WARNING cinder.quota [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1742871239-1146189294 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1742871239-1146189294, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:23:34 devstack cinder-volume[86456]: WARNING cinder.quota [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1742871239-1146189294 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1742871239-1146189294, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:23:34 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Created reservations ['b485e395-aa8e-4469-9084-8acf40e59c77', 'fc63193a-f231-49c8-82f3-61c1b96d8ed6', '76b9a0f3-e3fe-4cdd-90b5-1a0aad00ff7c', '57296edd-b182-487a-ae30-b8dd87d3921d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:35 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:23:35 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:35 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:23:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Deleted volume successfully. Jul 06 10:23:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6942769d-13a3-476f-9955-dca13514a83e tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-b047495b-0528-45f4-8b27-46eb4d274561-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-4c601c9a-9688-4194-b8ba-405d1a02ff93 tempest-TestShelveInstance-1107085916 None] Terminate volume connection completed successfully. Jul 06 10:23:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-4c601c9a-9688-4194-b8ba-405d1a02ff93 tempest-TestShelveInstance-1107085916 None] Deleting attachment cbe5581b-ac0d-41d3-8ec8-2f89e444b6f4. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:23:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Acquiring lock "cinder-34707bf8-7783-4bff-8e07-6237d95e7076-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Lock "cinder-34707bf8-7783-4bff-8e07-6237d95e7076-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Acquiring lock "cinder-quobyte-34707bf8-7783-4bff-8e07-6237d95e7076" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Lock "cinder-quobyte-34707bf8-7783-4bff-8e07-6237d95e7076" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de7bf46-72d0-46e8-8d67-bff01f39b063]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:23:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:37 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:23:37 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:38 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 0 in 0.957s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:38 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:23:38 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:39 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 1 in 0.847s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:23:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:39 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076 Jul 06 10:23:39 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:40 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34707bf8-7783-4bff-8e07-6237d95e7076" returned: 0 in 0.695s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Lock "cinder-quobyte-34707bf8-7783-4bff-8e07-6237d95e7076" released by "delete_volume" :: held 2.580s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG cinder.quota [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Created reservations ['5507e127-3495-405b-b2ec-351b3bae6fcb', '169c092f-e851-4d06-bd0e-6b530c3c7d2f', '138d00da-b7e3-4d3e-9bb6-7645e997f67c', '2cbdaea0-eaa9-4f47-98f2-6f00a3d8fb15'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:40 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:23:40 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:40 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-97bfc2bd-9af1-450e-b511-c608dc07354a req-5048160f-3115-4926-893c-293abe3d1815 tempest-TestInstancesWithCinderVolumes-1909193101 None] Terminate volume connection completed successfully. Jul 06 10:23:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-97bfc2bd-9af1-450e-b511-c608dc07354a req-5048160f-3115-4926-893c-293abe3d1815 tempest-TestInstancesWithCinderVolumes-1909193101 None] Deleting attachment d726cfa3-72d1-4623-b195-8ef3bf5c300a. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:23:41 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.793s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:41 devstack cinder-volume[86456]: DEBUG cinder.manager [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:23:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Deleted volume successfully. Jul 06 10:23:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [req-a57091f0-33f0-4fa6-9ba9-6747c72f25ff req-eead1503-53c5-4b31-9746-e7121f49c3df tempest-TestShelveInstance-1107085916 None] Lock "cinder-34707bf8-7783-4bff-8e07-6237d95e7076-delete_volume" released by "delete_volume" :: held 3.592s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "cinder-418bf251-7887-4e48-9c9e-5fe2b4df40ed-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-418bf251-7887-4e48-9c9e-5fe2b4df40ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "cinder-quobyte-418bf251-7887-4e48-9c9e-5fe2b4df40ed" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:23:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-quobyte-418bf251-7887-4e48-9c9e-5fe2b4df40ed" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:23:43 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a7725-b11c-43e4-b60c-2a6bcfc0e4a1]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:23:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:43 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:23:43 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:44 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 0 in 0.869s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:44 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:23:44 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:45 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 1 in 0.797s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:23:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:45 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed Jul 06 10:23:45 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:46 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-418bf251-7887-4e48-9c9e-5fe2b4df40ed" returned: 0 in 0.716s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-quobyte-418bf251-7887-4e48-9c9e-5fe2b4df40ed" released by "delete_volume" :: held 2.449s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:46 devstack cinder-volume[86456]: WARNING cinder.quota [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1035279953-171681776 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1035279953-171681776, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:23:46 devstack cinder-volume[86456]: WARNING cinder.quota [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1035279953-171681776 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1035279953-171681776, it is now deprecated. Please use the default quota class for default quota. Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Created reservations ['5346752d-90d1-43ee-a305-2994da4dcd6a', 'dfca122d-e6eb-4337-9e52-19a3bb3cccb5', '2886cf37-3970-40af-8654-71d88e1123d8', 'cdd9cc1d-4332-426a-868d-cad91057eda1'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:46 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:23:46 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:46 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.658s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:23:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Deleted volume successfully. Jul 06 10:23:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4b3e499e-103c-41e4-824f-f92a83b86b5d tempest-TestInstancesWithCinderVolumes-1909193101 None] Lock "cinder-418bf251-7887-4e48-9c9e-5fe2b4df40ed-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (c0492710-492f-4a4f-964a-005bda9372a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89447d6-4e7a-4221-9d4f-b313e5a55f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89447d6-4e7a-4221-9d4f-b313e5a55f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184712197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a584ec6-2804-4b1c-ba7a-d1c967f18b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:23:53Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ec01e0-a6bb-445c-8199-588a38018d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ec01e0-a6bb-445c-8199-588a38018d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4f5b00-c621-4612-b9bd-05a3872cedfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4f5b00-c621-4612-b9bd-05a3872cedfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a584ec6-2804-4b1c-ba7a-d1c967f18b46', 'volume_name': 'volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8092592f-82ae-4dee-8e51-6a0fe5a38171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8092592f-82ae-4dee-8e51-6a0fe5a38171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d6da98-3bb9-418b-b385-27ea9e4c5bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:23:53 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume 5a584ec6-2804-4b1c-ba7a-d1c967f18b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46', 'volume_size': 1} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184712197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a584ec6-2804-4b1c-ba7a-d1c967f18b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:23:53Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Creating volume 5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:23:53 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:23:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:53 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 1073741824 Jul 06 10:23:53 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:54 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 1073741824" returned: 0 in 0.826s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:54 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 Jul 06 10:23:54 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:55 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" returned: 0 in 0.697s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d6da98-3bb9-418b-b385-27ea9e4c5bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e49a7c-ef32-4a2d-b9d4-7f30ba4c0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:23:55 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 (5a584ec6-2804-4b1c-ba7a-d1c967f18b46): created successfully Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e49a7c-ef32-4a2d-b9d4-7f30ba4c0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (c0492710-492f-4a4f-964a-005bda9372a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:23:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-04e3b8aa-b6ff-4297-a64d-742eb2827bfa tempest-CreateVolumesFromSnapshotTest-401925653 None] Created volume successfully. Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Creating offline snapshot 32a51333-adb8-437d-a48e-ddc6e5bc678e of volume 5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cc47c6-dab9-4558-9f32-5df6ce5c78cd]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:23:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:55 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 Jul 06 10:23:55 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:56 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" returned: 0 in 0.778s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:56 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e 1G Jul 06 10:23:56 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:57 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e 1G" returned: 0 in 0.799s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:57 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e Jul 06 10:23:57 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:57 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e" returned: 0 in 0.659s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:57 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e is being set with open permissions: ugo+rw Jul 06 10:23:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:57 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e Jul 06 10:23:57 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:58 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e" returned: 0 in 0.668s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:58 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.info Jul 06 10:23:58 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:23:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:58 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:23:58 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:59 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.info" returned: 0 in 0.740s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:59 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.info is being set with open permissions: ugo+rw Jul 06 10:23:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:23:59 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.info Jul 06 10:23:59 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:23:59 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 06 10:23:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.744s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:23:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:23:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:23:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:23:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:24:00 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.info" returned: 0 in 0.674s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.421s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2f2932e7-d0e9-419f-a0a7-fd9e9bfed162 tempest-CreateVolumesFromSnapshotTest-401925653 None] Create snapshot completed successfully Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (58424e8e-21ed-4c22-b181-09b150378ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76c3fbf-f86f-4636-8046-afd5cc040a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76c3fbf-f86f-4636-8046-afd5cc040a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145222410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c82f3-9649-4037-82af-b236f4534a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:01Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3b2903-4679-4344-b643-eda46211d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3b2903-4679-4344-b643-eda46211d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0597ca7c-9f54-44d6-95ba-44ea97383e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0597ca7c-9f54-44d6-95ba-44ea97383e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5c82f3-9649-4037-82af-b236f4534a72', 'volume_name': 'volume-1e5c82f3-9649-4037-82af-b236f4534a72', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb08695-580f-4438-9a41-252f10e5205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb08695-580f-4438-9a41-252f10e5205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39df5f96-93d0-4785-997e-db5bd65d93b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume 1e5c82f3-9649-4037-82af-b236f4534a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5c82f3-9649-4037-82af-b236f4534a72', 'volume_size': 1} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145222410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c82f3-9649-4037-82af-b236f4534a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:01Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Creating volume 1e5c82f3-9649-4037-82af-b236f4534a72 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:01 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:01 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 1073741824 Jul 06 10:24:01 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (45ed29bf-d96b-4b97-9125-053bb07e96b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5152acf-3483-4e34-8072-b1e363df86a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5152acf-3483-4e34-8072-b1e363df86a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434556780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:02Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b92050c-9dca-456e-a550-5398162fb2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b92050c-9dca-456e-a550-5398162fb2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be30eaf-fb03-4132-8528-36fbdae6c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be30eaf-fb03-4132-8528-36fbdae6c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa', 'volume_name': 'volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9572cd5-146c-44d1-83d3-33186b9c41f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9572cd5-146c-44d1-83d3-33186b9c41f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e1f14c-9740-4064-9012-d52eee2faecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:02 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume 51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa', 'volume_size': 1} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (a76dac0f-3407-4db5-aecb-d84d7ec34d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54ac2cd-c80c-43ba-b77c-adf89e8023fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54ac2cd-c80c-43ba-b77c-adf89e8023fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628282889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402a1c99-fc8b-48da-a561-95be3c493a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:02Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20b36e2-eb40-4202-a1f4-32679dcbf703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20b36e2-eb40-4202-a1f4-32679dcbf703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103c2346-430c-47d6-8f4e-a8c1de66bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103c2346-430c-47d6-8f4e-a8c1de66bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '402a1c99-fc8b-48da-a561-95be3c493a5f', 'volume_name': 'volume-402a1c99-fc8b-48da-a561-95be3c493a5f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77ce655-4a1c-42ce-b365-4d58dcd2531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77ce655-4a1c-42ce-b365-4d58dcd2531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f8f22-a6e9-462f-afdb-a6269616e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:02 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume 402a1c99-fc8b-48da-a561-95be3c493a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-402a1c99-fc8b-48da-a561-95be3c493a5f', 'volume_size': 1} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:02 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 1073741824" returned: 0 in 1.247s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:02 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 Jul 06 10:24:02 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (899ca59e-abad-481d-8cb7-57c4f5ce8761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8e5349-0123-4023-82ff-cee833f5aafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8e5349-0123-4023-82ff-cee833f5aafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539638651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7601ca-2df0-4497-b722-51a185653968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:03Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f2f836-3069-4ddc-b31c-58de8f74dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f2f836-3069-4ddc-b31c-58de8f74dc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0218ade7-720f-45ce-a44c-a7cdbc215e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0218ade7-720f-45ce-a44c-a7cdbc215e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7601ca-2df0-4497-b722-51a185653968', 'volume_name': 'volume-bb7601ca-2df0-4497-b722-51a185653968', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cba0ed-b8d9-4472-9d83-545be68338a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72cba0ed-b8d9-4472-9d83-545be68338a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aad34ac-e6df-4f99-bae0-2299a84e54d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume bb7601ca-2df0-4497-b722-51a185653968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7601ca-2df0-4497-b722-51a185653968', 'volume_size': 1} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (63bc5286-356d-4be2-874a-c7985091149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8c3fda-c804-443a-ae16-fa4042398280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8c3fda-c804-443a-ae16-fa4042398280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213110648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72bc3fa-831a-4a70-863b-a26691c06bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:03Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d351859-774b-4091-b1d5-445fa3d5fbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d351859-774b-4091-b1d5-445fa3d5fbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69d8bfb-4cef-4ce7-aab1-93fee605c7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69d8bfb-4cef-4ce7-aab1-93fee605c7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72bc3fa-831a-4a70-863b-a26691c06bc3', 'volume_name': 'volume-c72bc3fa-831a-4a70-863b-a26691c06bc3', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b78de1f-9ab1-4cda-94de-07fa606dc27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b78de1f-9ab1-4cda-94de-07fa606dc27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ede32e-db42-43af-8c09-e9cee8fcb1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume c72bc3fa-831a-4a70-863b-a26691c06bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72bc3fa-831a-4a70-863b-a26691c06bc3', 'volume_size': 1} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:03 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72" returned: 0 in 0.764s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.625s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434556780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:02Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Creating volume 51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:03 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=45,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:24:03 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa 1073741824 Jul 06 10:24:03 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39df5f96-93d0-4785-997e-db5bd65d93b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5c82f3-9649-4037-82af-b236f4534a72', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da652ce-9547-48de-b488-3d9cca3044d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=49,cinder:UPDATE=43,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:24:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume volume-1e5c82f3-9649-4037-82af-b236f4534a72 (1e5c82f3-9649-4037-82af-b236f4534a72): created successfully Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da652ce-9547-48de-b488-3d9cca3044d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (58424e8e-21ed-4c22-b181-09b150378ff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-33d1d8c4-af87-4214-a1ac-afc2f11b6657 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created volume successfully. Jul 06 10:24:04 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa 1073741824" returned: 0 in 0.911s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:04 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa Jul 06 10:24:04 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:05 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa" returned: 0 in 0.668s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.897s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628282889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=402a1c99-fc8b-48da-a561-95be3c493a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:02Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Creating volume 402a1c99-fc8b-48da-a561-95be3c493a5f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:05 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:05 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f 1073741824 Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e1f14c-9740-4064-9012-d52eee2faecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:05 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47fe9c7-f5e0-44dc-830c-53159992d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa (51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa): created successfully Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47fe9c7-f5e0-44dc-830c-53159992d32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (45ed29bf-d96b-4b97-9125-053bb07e96b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e4ddd7a9-390f-4f15-a629-f59635178ffd tempest-CreateVolumesFromSnapshotTest-401925653 None] Created volume successfully. Jul 06 10:24:06 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f 1073741824" returned: 0 in 0.967s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:06 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f Jul 06 10:24:06 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:06 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f" returned: 0 in 0.670s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.912s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539638651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7601ca-2df0-4497-b722-51a185653968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:03Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Creating volume bb7601ca-2df0-4497-b722-51a185653968 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:06 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:06 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 1073741824 Jul 06 10:24:06 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:06 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782f8f22-a6e9-462f-afdb-a6269616e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-402a1c99-fc8b-48da-a561-95be3c493a5f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7e79a6-5e2a-4fc8-a18d-b1f355814aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:07 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume volume-402a1c99-fc8b-48da-a561-95be3c493a5f (402a1c99-fc8b-48da-a561-95be3c493a5f): created successfully Jul 06 10:24:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7e79a6-5e2a-4fc8-a18d-b1f355814aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (a76dac0f-3407-4db5-aecb-d84d7ec34d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-45d6466f-959c-4cb5-a004-6e268e2db428 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created volume successfully. Jul 06 10:24:07 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 1073741824" returned: 0 in 0.950s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:07 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 Jul 06 10:24:07 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:08 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968" returned: 0 in 0.629s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.195s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213110648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72bc3fa-831a-4a70-863b-a26691c06bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e2db3069a4649b5aa4e8a08cd645a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:03Z,use_quota=True,user_id='d29d69ad1d54489bbaa13389d27d3d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Creating volume c72bc3fa-831a-4a70-863b-a26691c06bc3 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:08 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:08 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 1073741824 Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aad34ac-e6df-4f99-bae0-2299a84e54d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7601ca-2df0-4497-b722-51a185653968', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:08 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd3d3d-4020-44b1-b187-2862bc16b3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:08 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume volume-bb7601ca-2df0-4497-b722-51a185653968 (bb7601ca-2df0-4497-b722-51a185653968): created successfully Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd3d3d-4020-44b1-b187-2862bc16b3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:08 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (899ca59e-abad-481d-8cb7-57c4f5ce8761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ba882e41-c8ec-476f-bb48-e26f8a2cb07f tempest-CreateVolumesFromSnapshotTest-401925653 None] Created volume successfully. Jul 06 10:24:09 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 1073741824" returned: 0 in 0.919s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:09 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 Jul 06 10:24:09 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:10 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3" returned: 0 in 0.672s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ede32e-db42-43af-8c09-e9cee8fcb1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72bc3fa-831a-4a70-863b-a26691c06bc3', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e5599f-fed3-47b6-9b43-7e3ed111175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:10 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Volume volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 (c72bc3fa-831a-4a70-863b-a26691c06bc3): created successfully Jul 06 10:24:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e5599f-fed3-47b6-9b43-7e3ed111175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Flow 'volume_create_manager' (63bc5286-356d-4be2-874a-c7985091149f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5e872abb-a8fc-4c3e-8cf9-5356682c69a8 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created volume successfully. Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-c72bc3fa-831a-4a70-863b-a26691c06bc3-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-c72bc3fa-831a-4a70-863b-a26691c06bc3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-c72bc3fa-831a-4a70-863b-a26691c06bc3" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-c72bc3fa-831a-4a70-863b-a26691c06bc3" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f23a6c-8f55-4ec7-aea2-eaf72d2af151]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:11 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 Jul 06 10:24:11 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:11 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3" returned: 0 in 0.787s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:11 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3 Jul 06 10:24:11 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:12 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c72bc3fa-831a-4a70-863b-a26691c06bc3" returned: 0 in 0.641s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-c72bc3fa-831a-4a70-863b-a26691c06bc3" released by "delete_volume" :: held 1.478s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created reservations ['7d25d16c-714d-4fec-bb6d-6bac84b17cd8', '393b8132-763b-4e7f-9283-91596c579005', 'f0dd4961-5a32-4b54-b99a-af7079215adf', '2db78357-fd3b-4418-87b9-eb248a2afb23'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:12 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:12 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-bb7601ca-2df0-4497-b722-51a185653968-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-bb7601ca-2df0-4497-b722-51a185653968-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-bb7601ca-2df0-4497-b722-51a185653968" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-bb7601ca-2df0-4497-b722-51a185653968" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67bc04c-4723-42c3-84c7-206a2a07d391]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:13 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Deleted volume successfully. Jul 06 10:24:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b5d147d6-6b65-4363-8d55-c5d202094c38 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-c72bc3fa-831a-4a70-863b-a26691c06bc3-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:13 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 Jul 06 10:24:13 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:14 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968" returned: 0 in 0.905s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:14 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968 Jul 06 10:24:14 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:15 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bb7601ca-2df0-4497-b722-51a185653968" returned: 0 in 0.662s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-bb7601ca-2df0-4497-b722-51a185653968" released by "delete_volume" :: held 1.632s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created reservations ['96132138-463a-4c26-b4d5-610fb0a8d90d', '143ae548-aa96-4f8d-9d90-38a0e561b149', '6c98d951-7fc7-409e-b616-eeceea6637cf', 'fa614beb-049a-4e64-a468-eb7f296ac730'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:15 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:15 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-402a1c99-fc8b-48da-a561-95be3c493a5f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-402a1c99-fc8b-48da-a561-95be3c493a5f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-402a1c99-fc8b-48da-a561-95be3c493a5f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-402a1c99-fc8b-48da-a561-95be3c493a5f" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0fc0c4-0cd0-49ee-8154-9d00acbb8982]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:15 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f Jul 06 10:24:15 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:16 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.907s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:16 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Deleted volume successfully. Jul 06 10:24:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-5cd20210-c8c9-4c88-96c0-0d4686beb222 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-bb7601ca-2df0-4497-b722-51a185653968-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:16 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f" returned: 0 in 1.005s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:16 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f Jul 06 10:24:16 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:17 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-402a1c99-fc8b-48da-a561-95be3c493a5f" returned: 0 in 0.653s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-402a1c99-fc8b-48da-a561-95be3c493a5f" released by "delete_volume" :: held 1.750s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created reservations ['cca6f44c-967c-4d1c-bd75-c205d3a9f19a', '6d214b5b-6700-475a-a379-808e522e4f77', '097ede0e-4159-4936-b32d-214597cbd548', '7789048c-98e5-4e75-b313-1c7910234704'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:17 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:17 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cdc45e-69f3-4147-bd97-b3d16e069ec8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:18 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa Jul 06 10:24:18 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:18 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.779s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Deleted volume successfully. Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-58748c1d-c83c-46a5-b3cc-b2899c2a5f45 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-402a1c99-fc8b-48da-a561-95be3c493a5f-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:18 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa" returned: 0 in 0.897s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:19 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa Jul 06 10:24:19 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:19 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa" released by "delete_volume" :: held 1.691s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created reservations ['48f66a24-e12a-4200-a08a-e6dff92a2f71', 'e381573c-458c-4d99-ac3d-b26198b60610', '47b14bc3-a511-473e-9672-50b645e483e2', '4fa3ec30-845f-4413-9b48-442c7e3320cc'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:19 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:19 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-1e5c82f3-9649-4037-82af-b236f4534a72-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-1e5c82f3-9649-4037-82af-b236f4534a72-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-1e5c82f3-9649-4037-82af-b236f4534a72" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-1e5c82f3-9649-4037-82af-b236f4534a72" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e636a8ed-1979-4a05-b8ee-9877c6f7650b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:20 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 Jul 06 10:24:20 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:20 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.793s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:20 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Deleted volume successfully. Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-33e124b8-beff-45a4-8544-3dff8cb29778 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-51e5b9dc-f8c3-4d1a-8bfe-ac391ff5d1fa-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Flow 'volume_create_manager' (58ccb4d9-c101-46c4-9722-4afbeba509fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ec93ee-2c86-450f-b7fb-6f742006f734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ec93ee-2c86-450f-b7fb-6f742006f734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2049970654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fb4533-fd4d-432d-971f-e3c3539810d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb215f8e39de475cbc0e5c832929cdcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:21Z,use_quota=True,user_id='830c0b7a4a99453eb5c5683bd21a6df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb2964d-160e-4f31-9d0e-4b3114880348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb2964d-160e-4f31-9d0e-4b3114880348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338c6268-94c8-4f2e-a101-ed5174a26e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338c6268-94c8-4f2e-a101-ed5174a26e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fb4533-fd4d-432d-971f-e3c3539810d4', 'volume_name': 'volume-95fb4533-fd4d-432d-971f-e3c3539810d4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9b5ed0-811b-415c-9d4d-19d4d5640e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9b5ed0-811b-415c-9d4d-19d4d5640e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fc1392-0f80-47d7-9604-7102e92dc836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:20 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Volume 95fb4533-fd4d-432d-971f-e3c3539810d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fb4533-fd4d-432d-971f-e3c3539810d4', 'volume_size': 1} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2049970654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fb4533-fd4d-432d-971f-e3c3539810d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb215f8e39de475cbc0e5c832929cdcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:21Z,use_quota=True,user_id='830c0b7a4a99453eb5c5683bd21a6df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Creating volume 95fb4533-fd4d-432d-971f-e3c3539810d4 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:20 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:20 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 1073741824 Jul 06 10:24:20 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Flow 'volume_create_manager' (7360b401-fd3c-4bc2-ae50-48e6e52d7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:21 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a9d579-b666-46db-80b0-c8ff61501a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72" returned: 0 in 0.897s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:21 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72 Jul 06 10:24:21 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a9d579-b666-46db-80b0-c8ff61501a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-999488936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7616470-77f9-4a1a-bf7b-65f60b6aa748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb215f8e39de475cbc0e5c832929cdcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:21Z,use_quota=True,user_id='830c0b7a4a99453eb5c5683bd21a6df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abf5510-fff7-4815-9004-e5eecf8a3433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abf5510-fff7-4815-9004-e5eecf8a3433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237f5f75-490d-41bf-8ab9-751894318bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (237f5f75-490d-41bf-8ab9-751894318bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7616470-77f9-4a1a-bf7b-65f60b6aa748', 'volume_name': 'volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423c0805-28c3-4d66-b5c2-7a2b740b3011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423c0805-28c3-4d66-b5c2-7a2b740b3011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386375d0-bd5c-45f7-a14e-77e81f852f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Volume c7616470-77f9-4a1a-bf7b-65f60b6aa748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748', 'volume_size': 1} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:21 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1e5c82f3-9649-4037-82af-b236f4534a72" returned: 0 in 0.714s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-1e5c82f3-9649-4037-82af-b236f4534a72" released by "delete_volume" :: held 1.663s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:21 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 1073741824" returned: 0 in 1.071s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Created reservations ['85dcdf0d-3f81-449d-9747-f72a48e82a6c', '4a7170ae-7a26-4f27-9dd6-22ffd1c207fd', '9fbc8b28-e935-4453-8040-67db6af15e7d', '2cb61802-7ced-4cf3-b469-abc72dbf53f0'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:22 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 Jul 06 10:24:22 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:22 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:22 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-32a51333-adb8-437d-a48e-ddc6e5bc678e-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-32a51333-adb8-437d-a48e-ddc6e5bc678e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-32a51333-adb8-437d-a48e-ddc6e5bc678e" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-32a51333-adb8-437d-a48e-ddc6e5bc678e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Deleting offline snapshot 32a51333-adb8-437d-a48e-ddc6e5bc678e of volume 5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] snapshot_file for this snap is: volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[629bf128-901f-4faf-ab5c-b41384b0c860]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:22 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e Jul 06 10:24:22 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:22 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4" returned: 0 in 0.777s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.504s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-999488936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7616470-77f9-4a1a-bf7b-65f60b6aa748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb215f8e39de475cbc0e5c832929cdcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:21Z,use_quota=True,user_id='830c0b7a4a99453eb5c5683bd21a6df2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Creating volume c7616470-77f9-4a1a-bf7b-65f60b6aa748 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:22 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:22 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 1073741824 Jul 06 10:24:22 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fc1392-0f80-47d7-9604-7102e92dc836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fb4533-fd4d-432d-971f-e3c3539810d4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea1dfcc-93bd-4384-bef8-303b08d637ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:22 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.772s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Deleted volume successfully. Jul 06 10:24:22 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Volume volume-95fb4533-fd4d-432d-971f-e3c3539810d4 (95fb4533-fd4d-432d-971f-e3c3539810d4): created successfully Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea1dfcc-93bd-4384-bef8-303b08d637ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Flow 'volume_create_manager' (58ccb4d9-c101-46c4-9722-4afbeba509fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1b097792-c75c-4e4c-ba32-2769175883a4 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Created volume successfully. Jul 06 10:24:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4dc74773-dac1-4dfc-bb5f-cba1b494e26e tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-1e5c82f3-9649-4037-82af-b236f4534a72-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:23 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e" returned: 0 in 0.883s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:24:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93000b-7145-4b04-8466-a35bea7caeb0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:23 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 Jul 06 10:24:23 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:23 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 1073741824" returned: 0 in 0.937s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:23 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 Jul 06 10:24:23 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:24 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" returned: 0 in 0.870s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:24 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e Jul 06 10:24:24 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:24 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748" returned: 0 in 0.808s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386375d0-bd5c-45f7-a14e-77e81f852f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001f7c7e-a57e-4917-8680-5158fcd51a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:24 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Volume volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 (c7616470-77f9-4a1a-bf7b-65f60b6aa748): created successfully Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001f7c7e-a57e-4917-8680-5158fcd51a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Flow 'volume_create_manager' (7360b401-fd3c-4bc2-ae50-48e6e52d7654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:24 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-69f15904-13c9-4c3f-b6e9-0f37c0234a5b tempest-TestServerVolumeAttachmentScenario-1719143728 None] Created volume successfully. Jul 06 10:24:25 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e" returned: 0 in 0.732s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:25 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e Jul 06 10:24:25 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:25 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46.32a51333-adb8-437d-a48e-ddc6e5bc678e" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-32a51333-adb8-437d-a48e-ddc6e5bc678e" released by "_delete_snapshot" :: held 3.292s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" released by "delete_snapshot" :: held 3.317s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:25 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Created reservations ['20bc4c36-f872-4d18-9c3a-f83650bce170', '6075ac56-b016-47eb-bf1d-d3c6600578d4', 'ecbe87f9-4399-4db3-b69d-51964b62fc5d', 'f135976e-a2cf-4fba-a819-573f2a8e8394'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:26 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Delete snapshot completed successfully. Jul 06 10:24:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ece4c45f-f507-430d-9aa0-8d27256837c5 tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-32a51333-adb8-437d-a48e-ddc6e5bc678e-delete_snapshot" released by "delete_snapshot" :: held 3.468s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-5a584ec6-2804-4b1c-ba7a-d1c967f18b46-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-5a584ec6-2804-4b1c-ba7a-d1c967f18b46-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "cinder-quobyte-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ec7b4-69b6-414d-9531-f58de1d3690d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:26 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 Jul 06 10:24:26 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:27 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" returned: 0 in 0.763s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:27 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46 Jul 06 10:24:27 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:28 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" returned: 0 in 0.640s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-quobyte-5a584ec6-2804-4b1c-ba7a-d1c967f18b46" released by "delete_volume" :: held 1.463s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Created reservations ['773b3efc-2fe5-45a9-8bef-2f722ae27d4e', '5bcd9174-f8c1-4731-be36-644d2e6f5be3', '314485b4-7951-4856-a70c-3305b2fc0e36', '85745c3d-5bcb-4c71-bf12-60ee33b8a7cc'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:28 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:28 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:29 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:29 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Deleted volume successfully. Jul 06 10:24:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-31fa6ddf-3ba6-4126-a8b9-cca092ceb8ef tempest-CreateVolumesFromSnapshotTest-401925653 None] Lock "cinder-5a584ec6-2804-4b1c-ba7a-d1c967f18b46-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Flow 'volume_create_manager' (631f4d8f-3cee-4ff2-9fc0-72ca66a81e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf096426-6c70-4340-bdda-1f7cdb99588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf096426-6c70-4340-bdda-1f7cdb99588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-712635184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b25d3b-5013-4aed-a124-cca82281ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1307919044b47b4a548213312431e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:32Z,use_quota=True,user_id='572a8b0ccb0746d99894c159b2e29400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583e2290-4774-45a2-a084-79e233b3a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583e2290-4774-45a2-a084-79e233b3a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74278da5-b998-4f32-b281-2080c27b5dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74278da5-b998-4f32-b281-2080c27b5dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b25d3b-5013-4aed-a124-cca82281ba8d', 'volume_name': 'volume-e8b25d3b-5013-4aed-a124-cca82281ba8d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df91251-1670-4161-9c8b-b5d21f69491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df91251-1670-4161-9c8b-b5d21f69491f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2769611f-380e-40bc-92b9-847beabbdcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:32 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Volume e8b25d3b-5013-4aed-a124-cca82281ba8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b25d3b-5013-4aed-a124-cca82281ba8d', 'volume_size': 1} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-712635184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b25d3b-5013-4aed-a124-cca82281ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1307919044b47b4a548213312431e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:32Z,use_quota=True,user_id='572a8b0ccb0746d99894c159b2e29400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Creating volume e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:32 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:24:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:32 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d 1073741824 Jul 06 10:24:32 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:33 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d 1073741824" returned: 0 in 0.951s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:33 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d Jul 06 10:24:33 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d" returned: 0 in 0.716s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:24:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:33 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2769611f-380e-40bc-92b9-847beabbdcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b25d3b-5013-4aed-a124-cca82281ba8d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab14b1cf-134f-4b7f-81d6-5a338dc76902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Volume volume-e8b25d3b-5013-4aed-a124-cca82281ba8d (e8b25d3b-5013-4aed-a124-cca82281ba8d): created successfully Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab14b1cf-134f-4b7f-81d6-5a338dc76902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Flow 'volume_create_manager' (631f4d8f-3cee-4ff2-9fc0-72ca66a81e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-153c43d8-ec0f-4a33-b787-5ab3fd498fee tempest-VolumeDependencyTests-1167516649 None] Created volume successfully. Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Creating offline snapshot c80c3395-1b42-4965-bc7e-7efe2ce3b831 of volume e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f1fcda-4491-4d4b-b553-e5fad8a1b9e3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:34 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d Jul 06 10:24:34 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:35 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d" returned: 0 in 0.921s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:35 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 1G Jul 06 10:24:35 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:36 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 1G" returned: 0 in 0.920s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b25d3b-5013-4aed-a124-cca82281ba8d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:36 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b25d3b-5013-4aed-a124-cca82281ba8d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 Jul 06 10:24:36 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:37 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b25d3b-5013-4aed-a124-cca82281ba8d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831" returned: 0 in 0.705s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:37 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 is being set with open permissions: ugo+rw Jul 06 10:24:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:37 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 Jul 06 10:24:37 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:37 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:38 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.info Jul 06 10:24:38 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:38 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.info" returned: 0 in 0.761s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:38 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.info is being set with open permissions: ugo+rw Jul 06 10:24:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:38 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.info Jul 06 10:24:38 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:39 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.info" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.930s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ec39a5fe-29bb-4f04-9613-92cfd2268722 tempest-VolumeDependencyTests-1167516649 None] Create snapshot completed successfully Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Flow 'volume_create_manager' (20002e87-7a47-49f1-829d-087cfc1013ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb191346-bdbb-429e-9b90-60e6dba19dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb191346-bdbb-429e-9b90-60e6dba19dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1265773707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35886865-c8ea-49e1-8834-ef280bff1122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1307919044b47b4a548213312431e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c80c3395-1b42-4965-bc7e-7efe2ce3b831,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:24:40Z,use_quota=True,user_id='572a8b0ccb0746d99894c159b2e29400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83780d15-5e10-45ed-b911-d7dddaa60b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83780d15-5e10-45ed-b911-d7dddaa60b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9d98fe-ab51-4e11-85e2-40968a735eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9d98fe-ab51-4e11-85e2-40968a735eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35886865-c8ea-49e1-8834-ef280bff1122', 'volume_name': 'volume-35886865-c8ea-49e1-8834-ef280bff1122', 'volume_size': 1, 'snapshot_id': 'c80c3395-1b42-4965-bc7e-7efe2ce3b831'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9708f99b-8bd5-42b6-8f55-da05a572b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9708f99b-8bd5-42b6-8f55-da05a572b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e877371-3a2f-40c8-a647-f589a88c45fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:40 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Volume 35886865-c8ea-49e1-8834-ef280bff1122: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35886865-c8ea-49e1-8834-ef280bff1122', 'volume_size': 1, 'snapshot_id': 'c80c3395-1b42-4965-bc7e-7efe2ce3b831'} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-quobyte-c80c3395-1b42-4965-bc7e-7efe2ce3b831-35886865-c8ea-49e1-8834-ef280bff1122" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-c80c3395-1b42-4965-bc7e-7efe2ce3b831-35886865-c8ea-49e1-8834-ef280bff1122" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Creating volume 35886865-c8ea-49e1-8834-ef280bff1122 from snapshot c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-quobyte-35886865-c8ea-49e1-8834-ef280bff1122" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-35886865-c8ea-49e1-8834-ef280bff1122" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] snapshot: c80c3395-1b42-4965-bc7e-7efe2ce3b831, volume: 35886865-c8ea-49e1-8834-ef280bff1122, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf309111-ebba-4034-a294-4d7d7f756a4c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:40 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 Jul 06 10:24:40 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:41 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831" returned: 0 in 0.852s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b25d3b-5013-4aed-a124-cca82281ba8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:24:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:24:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:24:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd69e0-0fa4-47c0-a04a-94f0bcb7e448]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:41 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d Jul 06 10:24:41 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:42 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d" returned: 0 in 0.765s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:42 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:24:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:42 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 Jul 06 10:24:42 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:47 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122" returned: 0 in 5.688s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:47 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeea85c4-fec7-4645-83f1-c42594cf28c2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:48 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d Jul 06 10:24:48 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:48 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d" returned: 0 in 0.980s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:48 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:24:48 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Converted 1024.00 MB image at 179.99 MB/s Jul 06 10:24:48 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 is being set with open permissions: ugo+rw Jul 06 10:24:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:49 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 Jul 06 10:24:49 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:49 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122" returned: 0 in 0.664s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-35886865-c8ea-49e1-8834-ef280bff1122" released by "_copy_volume_from_snapshot" :: held 9.037s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-c80c3395-1b42-4965-bc7e-7efe2ce3b831-35886865-c8ea-49e1-8834-ef280bff1122" released by "_create_volume_from_snapshot" :: held 9.069s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.087s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e877371-3a2f-40c8-a647-f589a88c45fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35886865-c8ea-49e1-8834-ef280bff1122', 'volume_size': 1, 'snapshot_id': 'c80c3395-1b42-4965-bc7e-7efe2ce3b831'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ee83b6-9701-4b3a-abf2-e2f8c369db41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:24:49 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Volume volume-35886865-c8ea-49e1-8834-ef280bff1122 (35886865-c8ea-49e1-8834-ef280bff1122): created successfully Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ee83b6-9701-4b3a-abf2-e2f8c369db41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:24:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Flow 'volume_create_manager' (20002e87-7a47-49f1-829d-087cfc1013ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:24:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1ca0ed83-9d87-4d75-bfc7-39eb4e4796ba tempest-VolumeDependencyTests-1167516649 None] Created volume successfully. Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-c80c3395-1b42-4965-bc7e-7efe2ce3b831-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-c80c3395-1b42-4965-bc7e-7efe2ce3b831-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-quobyte-e8b25d3b-5013-4aed-a124-cca82281ba8d" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-e8b25d3b-5013-4aed-a124-cca82281ba8d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-quobyte-c80c3395-1b42-4965-bc7e-7efe2ce3b831" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-c80c3395-1b42-4965-bc7e-7efe2ce3b831" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Deleting offline snapshot c80c3395-1b42-4965-bc7e-7efe2ce3b831 of volume e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] snapshot_file for this snap is: volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9993a643-afe6-44d1-9fcc-138e65421c3e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:50 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 Jul 06 10:24:50 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:51 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831" returned: 0 in 0.742s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b25d3b-5013-4aed-a124-cca82281ba8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:24:51 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7c8230-2c4d-45e1-b8e9-6eb5fbefc32f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:51 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d Jul 06 10:24:51 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:51 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d" returned: 0 in 0.766s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:52 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 Jul 06 10:24:52 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:52 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831" returned: 0 in 0.740s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:52 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831 Jul 06 10:24:52 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:53 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d.c80c3395-1b42-4965-bc7e-7efe2ce3b831" returned: 0 in 0.659s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-c80c3395-1b42-4965-bc7e-7efe2ce3b831" released by "_delete_snapshot" :: held 2.998s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-e8b25d3b-5013-4aed-a124-cca82281ba8d" released by "delete_snapshot" :: held 3.021s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:53 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Created reservations ['c8821315-ccdf-42ca-bfb9-9b0ccbb0e162', '9e393f39-7e1e-4674-83a0-dec0596f09a1', 'a4fb2a89-02d7-4951-a404-434e729348ae', 'a0c2624c-c24f-462b-811c-9a531626db79'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:53 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Delete snapshot completed successfully. Jul 06 10:24:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d1c62b96-746b-41b9-a581-81c0694b5216 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-c80c3395-1b42-4965-bc7e-7efe2ce3b831-delete_snapshot" released by "delete_snapshot" :: held 3.155s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-e8b25d3b-5013-4aed-a124-cca82281ba8d-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-e8b25d3b-5013-4aed-a124-cca82281ba8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-quobyte-e8b25d3b-5013-4aed-a124-cca82281ba8d" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-e8b25d3b-5013-4aed-a124-cca82281ba8d" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:54 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[114ceca8-d5aa-42ca-922b-3f5c35ad57e7]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:54 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d Jul 06 10:24:54 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:55 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d" returned: 0 in 0.768s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:55 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d Jul 06 10:24:55 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:56 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e8b25d3b-5013-4aed-a124-cca82281ba8d" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-e8b25d3b-5013-4aed-a124-cca82281ba8d" released by "delete_volume" :: held 1.502s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Created reservations ['57f3054c-3c2c-4817-80a3-97761f08c7ab', 'b775cb5e-b17d-4da8-ae85-b892e73098ff', '8288fc7f-e275-4d10-8a23-0c4fccc180df', '29f8ae83-49a7-49d9-aba3-cca49acfa2aa'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:56 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:56 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-35886865-c8ea-49e1-8834-ef280bff1122-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-35886865-c8ea-49e1-8834-ef280bff1122-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "cinder-quobyte-35886865-c8ea-49e1-8834-ef280bff1122" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:24:56 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-35886865-c8ea-49e1-8834-ef280bff1122" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:24:57 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb859f80-535a-497d-9f25-2fa167190678]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:24:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:57 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.739s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:57 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:57 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Deleted volume successfully. Jul 06 10:24:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6af15e43-4a57-4b95-b83c-c61c82668f77 tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-e8b25d3b-5013-4aed-a124-cca82281ba8d-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:57 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 Jul 06 10:24:57 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:57 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122" returned: 0 in 0.819s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:57 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122 Jul 06 10:24:57 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:58 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-35886865-c8ea-49e1-8834-ef280bff1122" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-quobyte-35886865-c8ea-49e1-8834-ef280bff1122" released by "delete_volume" :: held 1.541s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Created reservations ['22996485-ee53-483a-a889-9a7e54521b56', '75f9a343-0b26-4315-9318-d7de6ee8cd04', '12a3c2e8-d00b-4653-866c-35e6a3cf7c8d', 'b5adfb6b-02f0-4899-bdcc-19e5c2e49ad8'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:58 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:58 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:24:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:24:58 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:24:58 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:24:59 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.636s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Deleted volume successfully. Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c5aeee6b-b095-403c-9ca7-a322386398eb tempest-VolumeDependencyTests-1167516649 None] Lock "cinder-35886865-c8ea-49e1-8834-ef280bff1122-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:24:59 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.705s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:24:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:25:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-bf9592e6-8919-413d-b3f0-7a58623180d6 req-0b0c803a-e156-4755-8cb1-b392bb5a9d49 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:25:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-bf9592e6-8919-413d-b3f0-7a58623180d6 req-0b0c803a-e156-4755-8cb1-b392bb5a9d49 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:25:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9588388-09ef-46a4-bf6e-3664a24c52d0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:25:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bf9592e6-8919-413d-b3f0-7a58623180d6 req-0b0c803a-e156-4755-8cb1-b392bb5a9d49 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:03 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 Jul 06 10:25:03 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:04 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-bf9592e6-8919-413d-b3f0-7a58623180d6 req-0b0c803a-e156-4755-8cb1-b392bb5a9d49 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4" returned: 0 in 0.882s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-bf9592e6-8919-413d-b3f0-7a58623180d6 req-0b0c803a-e156-4755-8cb1-b392bb5a9d49 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:25:04 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=98,cinder:DELETE=10,cinder:SELECT=74,cinder:INSERT=29 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:04 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=64,cinder:INSERT=19,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-bf9592e6-8919-413d-b3f0-7a58623180d6 req-0b0c803a-e156-4755-8cb1-b392bb5a9d49 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-95fb4533-fd4d-432d-971f-e3c3539810d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02f88b9c-1034-401d-b8e5-31ef4949c15a', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:25:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-bf9592e6-8919-413d-b3f0-7a58623180d6 req-0b0c803a-e156-4755-8cb1-b392bb5a9d49 tempest-TestServerVolumeAttachmentScenario-1719143728 None] attachment_update completed successfully. Jul 06 10:25:14 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:14 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-3b4ac1d3-a80a-49cd-962c-0c01c7525d53 req-cb7b5a63-bbba-45b9-a10a-017366a03084 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:25:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-3b4ac1d3-a80a-49cd-962c-0c01c7525d53 req-cb7b5a63-bbba-45b9-a10a-017366a03084 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:25:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[4972d32a-3e59-4ba0-a2a0-a31d1a2f75b7]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:25:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-3b4ac1d3-a80a-49cd-962c-0c01c7525d53 req-cb7b5a63-bbba-45b9-a10a-017366a03084 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:14 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 Jul 06 10:25:14 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:15 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-3b4ac1d3-a80a-49cd-962c-0c01c7525d53 req-cb7b5a63-bbba-45b9-a10a-017366a03084 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748" returned: 0 in 0.768s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-3b4ac1d3-a80a-49cd-962c-0c01c7525d53 req-cb7b5a63-bbba-45b9-a10a-017366a03084 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.784s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:25:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-3b4ac1d3-a80a-49cd-962c-0c01c7525d53 req-cb7b5a63-bbba-45b9-a10a-017366a03084 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd0fbc2b-a427-471c-8599-43d4b45ce13b', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:25:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-3b4ac1d3-a80a-49cd-962c-0c01c7525d53 req-cb7b5a63-bbba-45b9-a10a-017366a03084 tempest-TestServerVolumeAttachmentScenario-1719143728 None] attachment_update completed successfully. Jul 06 10:25:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-0c897ad8-5ed2-422f-8fec-cc53288a7cbb req-6ad70488-54ca-4990-b7f3-0349e4f5db50 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Terminate volume connection completed successfully. Jul 06 10:25:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-0c897ad8-5ed2-422f-8fec-cc53288a7cbb req-6ad70488-54ca-4990-b7f3-0349e4f5db50 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Deleting attachment cd0fbc2b-a427-471c-8599-43d4b45ce13b. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:25:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-f7e3974b-519a-4800-8d02-efda99a9dd13 req-8564d1b4-46ce-4d2f-9822-9197b0b6a481 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Terminate volume connection completed successfully. Jul 06 10:25:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-f7e3974b-519a-4800-8d02-efda99a9dd13 req-8564d1b4-46ce-4d2f-9822-9197b0b6a481 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Deleting attachment 02f88b9c-1034-401d-b8e5-31ef4949c15a. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "cinder-c7616470-77f9-4a1a-bf7b-65f60b6aa748-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-c7616470-77f9-4a1a-bf7b-65f60b6aa748-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "cinder-quobyte-c7616470-77f9-4a1a-bf7b-65f60b6aa748" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-quobyte-c7616470-77f9-4a1a-bf7b-65f60b6aa748" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffca23b-77a7-4099-94b3-b0154e3a909c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:25:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:35 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 Jul 06 10:25:35 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:36 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748" returned: 0 in 0.743s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:36 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748 Jul 06 10:25:36 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:36 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c7616470-77f9-4a1a-bf7b-65f60b6aa748" returned: 0 in 0.619s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-quobyte-c7616470-77f9-4a1a-bf7b-65f60b6aa748" released by "delete_volume" :: held 1.399s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Created reservations ['63999bba-5f65-4b2a-b89b-88571cfdc6a3', '9a3f5d54-3b04-486b-b33c-53c9c3061a0c', '3d806d77-1379-4497-8a54-9855b5aa3e52', 'e278b1f1-cc13-4a14-a0e3-ac15ecacb3a2'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:25:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:36 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:25:36 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "cinder-95fb4533-fd4d-432d-971f-e3c3539810d4-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-95fb4533-fd4d-432d-971f-e3c3539810d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:25:37 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.679s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:25:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Deleted volume successfully. Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "cinder-quobyte-95fb4533-fd4d-432d-971f-e3c3539810d4" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-406e8476-05e8-45a2-beaa-1b93801c0723 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-c7616470-77f9-4a1a-bf7b-65f60b6aa748-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-quobyte-95fb4533-fd4d-432d-971f-e3c3539810d4" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c74d29-48ec-4e3f-a243-d8223dcf5174]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:25:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:37 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 Jul 06 10:25:37 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:38 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4" returned: 0 in 0.743s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:38 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4 Jul 06 10:25:38 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:38 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-95fb4533-fd4d-432d-971f-e3c3539810d4" returned: 0 in 0.617s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-quobyte-95fb4533-fd4d-432d-971f-e3c3539810d4" released by "delete_volume" :: held 1.398s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:25:38 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Created reservations ['52dd67c5-3d54-438a-a516-c76b3e02dba0', 'eba27411-ac72-471e-bf86-48cc2d56a634', '84c71a7b-46a2-4477-b4a9-65d54f33663a', '412f462f-9cb0-41ce-976a-378a1c7ba51b'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:39 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:25:39 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:39 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.629s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:25:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Deleted volume successfully. Jul 06 10:25:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d23ddd2d-80e6-4876-88ac-7a90d30b2be3 tempest-TestServerVolumeAttachmentScenario-1719143728 None] Lock "cinder-95fb4533-fd4d-432d-971f-e3c3539810d4-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:25:49 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:49 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=9,cinder:INSERT=7,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:25:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:25:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:25:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:25:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:25:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:25:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:25:58 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:25:59 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:25:59 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 06 10:25:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.745s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:25:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:25:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:25:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:25:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:25:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:25:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Flow 'volume_create_manager' (ab921d8b-0729-4fe8-953d-b400f300dbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721b2443-f01e-4762-920f-3929380f636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721b2443-f01e-4762-920f-3929380f636f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1162082573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06062bf8-a74c-45be-ad7f-be73cbe33559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e7e97d9c8f4c5b8c35faada13e40de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:26:12Z,use_quota=True,user_id='736380bdeee742bb8d908d8b116d2b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6922ca98-762c-4480-9402-86cd1ac96ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6922ca98-762c-4480-9402-86cd1ac96ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2011a4-0ab0-417a-864b-e329709524b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2011a4-0ab0-417a-864b-e329709524b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06062bf8-a74c-45be-ad7f-be73cbe33559', 'volume_name': 'volume-06062bf8-a74c-45be-ad7f-be73cbe33559', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ed083d-11da-4c07-ba1b-b8694187afb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ed083d-11da-4c07-ba1b-b8694187afb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dca0e5b-26c0-4236-8231-9cc40aa45737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:26:11 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Volume 06062bf8-a74c-45be-ad7f-be73cbe33559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06062bf8-a74c-45be-ad7f-be73cbe33559', 'volume_size': 1} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1162082573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06062bf8-a74c-45be-ad7f-be73cbe33559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e7e97d9c8f4c5b8c35faada13e40de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:26:12Z,use_quota=True,user_id='736380bdeee742bb8d908d8b116d2b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Creating volume 06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:26:11 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:26:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:26:11 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 1073741824 Jul 06 10:26:11 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:26:12 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 06 10:26:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 1073741824" returned: 0 in 0.862s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:26:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:26:12 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:26:12 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:26:13 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 06 10:26:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:26:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:26:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:26:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dca0e5b-26c0-4236-8231-9cc40aa45737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06062bf8-a74c-45be-ad7f-be73cbe33559', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:26:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2bddf8-55f5-4668-9616-11a2b6c376cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:26:13 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Volume volume-06062bf8-a74c-45be-ad7f-be73cbe33559 (06062bf8-a74c-45be-ad7f-be73cbe33559): created successfully Jul 06 10:26:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2bddf8-55f5-4668-9616-11a2b6c376cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:26:13 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Flow 'volume_create_manager' (ab921d8b-0729-4fe8-953d-b400f300dbbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:26:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-403f7a76-12d9-46ff-ade8-2fa48dcc3f65 tempest-TestStampPattern-37280012 None] Created volume successfully. Jul 06 10:26:23 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:26:23 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:26:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-1b305148-b96e-48ea-baf9-0638118be5d1 req-27afa8f4-63df-4292-9e06-46920633e772 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:26:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-1b305148-b96e-48ea-baf9-0638118be5d1 req-27afa8f4-63df-4292-9e06-46920633e772 tempest-TestStampPattern-37280012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:26:51 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff9b4b1-7ded-4209-bd6e-b224702c4521]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:26:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-1b305148-b96e-48ea-baf9-0638118be5d1 req-27afa8f4-63df-4292-9e06-46920633e772 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:26:51 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:26:51 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:26:51 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 06 10:26:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-1b305148-b96e-48ea-baf9-0638118be5d1 req-27afa8f4-63df-4292-9e06-46920633e772 tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 0.716s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:26:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-1b305148-b96e-48ea-baf9-0638118be5d1 req-27afa8f4-63df-4292-9e06-46920633e772 tempest-TestStampPattern-37280012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.730s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:26:51 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-1b305148-b96e-48ea-baf9-0638118be5d1 req-27afa8f4-63df-4292-9e06-46920633e772 tempest-TestStampPattern-37280012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-06062bf8-a74c-45be-ad7f-be73cbe33559', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef17884b-fbc0-4db7-9736-fd35c732691e', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:26:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-1b305148-b96e-48ea-baf9-0638118be5d1 req-27afa8f4-63df-4292-9e06-46920633e772 tempest-TestStampPattern-37280012 None] attachment_update completed successfully. Jul 06 10:26:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:26:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:26:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:26:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:26:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:26:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:26:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:26:58 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:26:58 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:26:59 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jul 06 10:26:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.690s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:26:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:26:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:26:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:26:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:26:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-6c06e52a-fac8-48a6-965e-12dd84cba75b req-ce06efa3-d258-419b-b8c3-5825774cc7e3 tempest-TestStampPattern-37280012 None] Terminate volume connection completed successfully. Jul 06 10:26:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-6c06e52a-fac8-48a6-965e-12dd84cba75b req-ce06efa3-d258-419b-b8c3-5825774cc7e3 tempest-TestStampPattern-37280012 None] Deleting attachment ef17884b-fbc0-4db7-9736-fd35c732691e. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:27:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:27:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:27:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Creating offline snapshot 7b1a752e-00ab-42a2-abd3-c482fb265aa9 of volume 06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:27:02 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7cdf6-591a-47d6-9955-8a5e609733db]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:27:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:02 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:27:02 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:02 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 0.720s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:02 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 1G Jul 06 10:27:02 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:03 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 1G" returned: 0 in 0.774s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06062bf8-a74c-45be-ad7f-be73cbe33559 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:03 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06062bf8-a74c-45be-ad7f-be73cbe33559 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 Jul 06 10:27:03 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:04 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06062bf8-a74c-45be-ad7f-be73cbe33559 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9" returned: 0 in 0.723s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:04 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 is being set with open permissions: ugo+rw Jul 06 10:27:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:04 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 Jul 06 10:27:04 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:04 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9" returned: 0 in 0.600s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:05 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.info Jul 06 10:27:05 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:05 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.info" returned: 0 in 0.628s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:05 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.info is being set with open permissions: ugo+rw Jul 06 10:27:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:05 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.info Jul 06 10:27:05 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:06 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.info" returned: 0 in 0.618s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.148s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:27:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-702a7830-b0d0-4458-8569-bdf41f2c17c9 tempest-TestStampPattern-37280012 None] Create snapshot completed successfully Jul 06 10:27:16 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:27:16 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:27:16 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Flow 'volume_create_manager' (0ae51046-d48e-45da-add2-4f0868380119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a382de-702a-42cf-a41f-d4c1f42123ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a382de-702a-42cf-a41f-d4c1f42123ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1988509287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf9960b-0ba3-4999-ba95-ee68c9a0be21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45e7e97d9c8f4c5b8c35faada13e40de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7b1a752e-00ab-42a2-abd3-c482fb265aa9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:27:17Z,use_quota=True,user_id='736380bdeee742bb8d908d8b116d2b31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4982401e-9e38-42ba-959b-ac63d79810d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4982401e-9e38-42ba-959b-ac63d79810d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6e447b-6380-4650-8217-1d864b7b1f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6e447b-6380-4650-8217-1d864b7b1f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fcf9960b-0ba3-4999-ba95-ee68c9a0be21', 'volume_name': 'volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21', 'volume_size': 1, 'snapshot_id': '7b1a752e-00ab-42a2-abd3-c482fb265aa9'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a5c045-aa69-451d-b3fa-8f73daa5c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a5c045-aa69-451d-b3fa-8f73daa5c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad30e28-a528-4784-9e37-7eb815e1a30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:27:17 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Volume fcf9960b-0ba3-4999-ba95-ee68c9a0be21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21', 'volume_size': 1, 'snapshot_id': '7b1a752e-00ab-42a2-abd3-c482fb265aa9'} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-quobyte-7b1a752e-00ab-42a2-abd3-c482fb265aa9-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-7b1a752e-00ab-42a2-abd3-c482fb265aa9-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Creating volume fcf9960b-0ba3-4999-ba95-ee68c9a0be21 from snapshot 7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-quobyte-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] snapshot: 7b1a752e-00ab-42a2-abd3-c482fb265aa9, volume: fcf9960b-0ba3-4999-ba95-ee68c9a0be21, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c87b385-8a4a-43ff-97a6-2e4c00a585cd]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:17 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 Jul 06 10:27:17 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:17 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9" returned: 0 in 0.805s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06062bf8-a74c-45be-ad7f-be73cbe33559(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea97865-6ad0-4dec-9c7d-7066cf6b1167]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:27:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:18 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:27:18 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:18 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 0.745s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:18 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:27:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:18 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 Jul 06 10:27:18 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:23 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" returned: 0 in 4.932s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc484a98-039f-4233-9c65-de6ceca63c5b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:27:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:23 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:27:23 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:24 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 1.124s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:24 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:27:24 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Converted 1024.00 MB image at 207.58 MB/s Jul 06 10:27:24 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 is being set with open permissions: ugo+rw Jul 06 10:27:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:24 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 Jul 06 10:27:24 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:25 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" returned: 0 in 0.871s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" released by "_copy_volume_from_snapshot" :: held 8.576s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-7b1a752e-00ab-42a2-abd3-c482fb265aa9-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" released by "_create_volume_from_snapshot" :: held 8.608s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.623s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ad30e28-a528-4784-9e37-7eb815e1a30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21', 'volume_size': 1, 'snapshot_id': '7b1a752e-00ab-42a2-abd3-c482fb265aa9'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a910f24-c8fc-4699-a8b8-f5c91b820104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:27:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Volume volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 (fcf9960b-0ba3-4999-ba95-ee68c9a0be21): created successfully Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a910f24-c8fc-4699-a8b8-f5c91b820104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:27:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Flow 'volume_create_manager' (0ae51046-d48e-45da-add2-4f0868380119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:27:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9e33a0fc-4dfa-4e37-82cd-a6eebd623a31 tempest-TestStampPattern-37280012 None] Created volume successfully. Jul 06 10:27:35 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:27:35 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:27:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:27:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:27:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:27:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:27:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:27:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:27:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:27:58 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:27:58 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:27:59 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Jul 06 10:27:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.627s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:27:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:27:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:27:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:27:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:27:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:28:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-4a7a0667-1986-48ca-8fc8-da897d225339 req-9b76e8ec-9183-4f91-ba31-32060f7e3f8b tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:28:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-4a7a0667-1986-48ca-8fc8-da897d225339 req-9b76e8ec-9183-4f91-ba31-32060f7e3f8b tempest-TestStampPattern-37280012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:28:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaafe013-9f92-4b9a-9870-75d37d2a0570]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:28:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-4a7a0667-1986-48ca-8fc8-da897d225339 req-9b76e8ec-9183-4f91-ba31-32060f7e3f8b tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:14 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 Jul 06 10:28:14 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:15 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [req-4a7a0667-1986-48ca-8fc8-da897d225339 req-9b76e8ec-9183-4f91-ba31-32060f7e3f8b tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" returned: 0 in 0.749s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [req-4a7a0667-1986-48ca-8fc8-da897d225339 req-9b76e8ec-9183-4f91-ba31-32060f7e3f8b tempest-TestStampPattern-37280012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:28:15 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-4a7a0667-1986-48ca-8fc8-da897d225339 req-9b76e8ec-9183-4f91-ba31-32060f7e3f8b tempest-TestStampPattern-37280012 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba', 'name': 'volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5d56e08-11dd-43b8-ae04-0123147a2422', 'enforce_multipath': True} {{(pid=86456) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 10:28:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-4a7a0667-1986-48ca-8fc8-da897d225339 req-9b76e8ec-9183-4f91-ba31-32060f7e3f8b tempest-TestStampPattern-37280012 None] attachment_update completed successfully. Jul 06 10:28:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [req-7a69c2bd-f65f-4eef-896d-124cce0b9972 req-047d9461-83e2-4b86-a7d8-9f6f2dfe9baf tempest-TestStampPattern-37280012 None] Terminate volume connection completed successfully. Jul 06 10:28:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [req-7a69c2bd-f65f-4eef-896d-124cce0b9972 req-047d9461-83e2-4b86-a7d8-9f6f2dfe9baf tempest-TestStampPattern-37280012 None] Deleting attachment e5d56e08-11dd-43b8-ae04-0123147a2422. {{(pid=86456) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 10:28:25 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:28:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-fcf9960b-0ba3-4999-ba95-ee68c9a0be21-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:28:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Lock "cinder-fcf9960b-0ba3-4999-ba95-ee68c9a0be21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:28:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-quobyte-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:28:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" acquired by "delete_volume" :: waited 0.011s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:28:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474c05c-4936-4613-96cb-49177cd68ab8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:28:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:32 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 Jul 06 10:28:32 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:32 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" returned: 0 in 0.721s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:32 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21 Jul 06 10:28:32 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:33 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" returned: 0 in 0.625s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-fcf9960b-0ba3-4999-ba95-ee68c9a0be21" released by "delete_volume" :: held 1.385s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Created reservations ['9bac910e-f620-4e65-af4c-cb2632709e1f', '9f571572-537d-4af5-96ae-1f1941d0069b', 'fa5ae568-18f1-4c6b-b76f-63df3fb47419', '92c1d58e-792b-45a0-8d97-407eafe40809'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:28:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:33 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:28:33 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:34 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.616s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:28:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Deleted volume successfully. Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f62152b3-954a-4c26-8690-a6179e455120 tempest-TestStampPattern-37280012 None] Lock "cinder-fcf9960b-0ba3-4999-ba95-ee68c9a0be21-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-7b1a752e-00ab-42a2-abd3-c482fb265aa9-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Lock "cinder-7b1a752e-00ab-42a2-abd3-c482fb265aa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-quobyte-06062bf8-a74c-45be-ad7f-be73cbe33559" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-06062bf8-a74c-45be-ad7f-be73cbe33559" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-quobyte-7b1a752e-00ab-42a2-abd3-c482fb265aa9" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-7b1a752e-00ab-42a2-abd3-c482fb265aa9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Deleting offline snapshot 7b1a752e-00ab-42a2-abd3-c482fb265aa9 of volume 06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] snapshot_file for this snap is: volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6a5db-4882-4075-9281-279e93c023c8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:28:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:34 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 Jul 06 10:28:34 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:35 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9" returned: 0 in 0.723s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06062bf8-a74c-45be-ad7f-be73cbe33559(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:28:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a55b5c6-c425-4cbb-abf2-9a9f95369359]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:28:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:35 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:28:35 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:35 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 0.699s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:35 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 Jul 06 10:28:35 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:36 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9" returned: 0 in 0.682s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:36 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9 Jul 06 10:28:36 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:37 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559.7b1a752e-00ab-42a2-abd3-c482fb265aa9" returned: 0 in 0.605s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-7b1a752e-00ab-42a2-abd3-c482fb265aa9" released by "_delete_snapshot" :: held 2.798s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:28:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-06062bf8-a74c-45be-ad7f-be73cbe33559" released by "delete_snapshot" :: held 2.829s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:28:37 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Created reservations ['6928a88f-4fbd-46bd-831d-4899dbd6e743', 'fc468493-ce2b-40cf-80d0-4313faf894a7', '094fd77c-1197-4830-b37d-ccf83d5193b5', 'afaf9388-a76a-41db-b320-2631720eb594'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:28:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Delete snapshot completed successfully. Jul 06 10:28:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9273056f-0b92-4ea8-9983-2ecbfed4b13b tempest-TestStampPattern-37280012 None] Lock "cinder-7b1a752e-00ab-42a2-abd3-c482fb265aa9-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:28:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-06062bf8-a74c-45be-ad7f-be73cbe33559-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:28:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Lock "cinder-06062bf8-a74c-45be-ad7f-be73cbe33559-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:28:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Acquiring lock "cinder-quobyte-06062bf8-a74c-45be-ad7f-be73cbe33559" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:28:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-06062bf8-a74c-45be-ad7f-be73cbe33559" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:28:45 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7427ae-2075-401d-aedc-58118ab20d54]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:28:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:45 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:28:45 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:46 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 0.741s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:46 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559 Jul 06 10:28:46 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:47 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-06062bf8-a74c-45be-ad7f-be73cbe33559" returned: 0 in 0.624s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Lock "cinder-quobyte-06062bf8-a74c-45be-ad7f-be73cbe33559" released by "delete_volume" :: held 1.417s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Created reservations ['30d490af-7487-4587-9ebd-b4f0d0936449', 'e7f7fb63-b49c-46e4-970b-f0b83a4c3d9c', 'ce2eca10-dc9b-4b67-9db3-ca4fe950a405', '0e9bf924-76e1-46d9-bdcd-70794ba3157a'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:47 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:28:47 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:47 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.661s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:28:47 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Deleted volume successfully. Jul 06 10:28:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c05745aa-1b80-4af8-a137-aef70a3a54f2 tempest-TestStampPattern-37280012 None] Lock "cinder-06062bf8-a74c-45be-ad7f-be73cbe33559-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:28:57 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=21,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:28:57 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Flow 'volume_create_manager' (94c6fe32-d282-424f-925c-54a15853c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b9687e-977e-4ed6-aba9-fbc6a8758172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b9687e-977e-4ed6-aba9-fbc6a8758172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1123892680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f04148f-c8aa-4fcf-a8ec-71159b0d2809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed37cb2fb424145a2c072cd22a15c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:28:58Z,use_quota=True,user_id='38ac7e465b99434ab961cea5936262f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ecd978-4838-43fa-8786-00d9ef866cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ecd978-4838-43fa-8786-00d9ef866cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95064de0-4397-4ee5-9322-041f4c1e4580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95064de0-4397-4ee5-9322-041f4c1e4580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f04148f-c8aa-4fcf-a8ec-71159b0d2809', 'volume_name': 'volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2bd72e-3737-4acd-a3b6-3c9358b56ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2bd72e-3737-4acd-a3b6-3c9358b56ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b307255-023f-448b-ae5e-034321787617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:28:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Volume 3f04148f-c8aa-4fcf-a8ec-71159b0d2809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809', 'volume_size': 1} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1123892680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f04148f-c8aa-4fcf-a8ec-71159b0d2809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed37cb2fb424145a2c072cd22a15c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:28:58Z,use_quota=True,user_id='38ac7e465b99434ab961cea5936262f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Creating volume 3f04148f-c8aa-4fcf-a8ec-71159b0d2809 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:28:58 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:58 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 1073741824 Jul 06 10:28:58 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:28:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:58 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:28:58 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:59 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 1073741824" returned: 0 in 0.768s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:28:59 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 Jul 06 10:28:59 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:28:59 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.640s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:28:59 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809" returned: 0 in 0.604s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b307255-023f-448b-ae5e-034321787617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e7fc2d-52f1-49a9-828c-d4d67984969a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:28:59 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Volume volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 (3f04148f-c8aa-4fcf-a8ec-71159b0d2809): created successfully Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e7fc2d-52f1-49a9-828c-d4d67984969a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:28:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Flow 'volume_create_manager' (94c6fe32-d282-424f-925c-54a15853c50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:28:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c80b5743-2b3e-4efc-a4ce-11381534a73e tempest-ProjectReaderTests-1728716315 None] Created volume successfully. Jul 06 10:29:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "cinder-3f04148f-c8aa-4fcf-a8ec-71159b0d2809-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-3f04148f-c8aa-4fcf-a8ec-71159b0d2809-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "cinder-quobyte-3f04148f-c8aa-4fcf-a8ec-71159b0d2809" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-quobyte-3f04148f-c8aa-4fcf-a8ec-71159b0d2809" acquired by "delete_volume" :: waited 0.012s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[299de04e-6355-4b22-8e51-8ef7ac5b8fdb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:00 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 Jul 06 10:29:00 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:01 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:01 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809 Jul 06 10:29:01 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:01 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-3f04148f-c8aa-4fcf-a8ec-71159b0d2809" returned: 0 in 0.598s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-quobyte-3f04148f-c8aa-4fcf-a8ec-71159b0d2809" released by "delete_volume" :: held 1.363s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Created reservations ['70bbdc38-bdb4-4d07-8e66-26bc92219002', 'b0f87d44-769f-423a-93a4-dc3f60302fd8', '616c627f-bc3a-4097-88d6-68bcd5c88317', '2c421c7e-779a-4574-9dde-071cfddfe794'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:01 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:01 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:02 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.597s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:02 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Deleted volume successfully. Jul 06 10:29:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-bc804909-c6c7-4093-a954-2e0ac87c5029 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-3f04148f-c8aa-4fcf-a8ec-71159b0d2809-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Flow 'volume_create_manager' (71761c7a-ff69-4648-8445-59842641e089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52e86fc-334c-4395-bd6d-7a5748540046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52e86fc-334c-4395-bd6d-7a5748540046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188647151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cee54f-7095-41de-adf9-8140e3e48681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed37cb2fb424145a2c072cd22a15c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:03Z,use_quota=True,user_id='38ac7e465b99434ab961cea5936262f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1400b7d0-64f1-4102-b277-e1317a2ac7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1400b7d0-64f1-4102-b277-e1317a2ac7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f40bce-18e5-4dd6-996c-821fe557edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f40bce-18e5-4dd6-996c-821fe557edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cee54f-7095-41de-adf9-8140e3e48681', 'volume_name': 'volume-00cee54f-7095-41de-adf9-8140e3e48681', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eedde39-0698-44f2-9c5c-547493f45269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eedde39-0698-44f2-9c5c-547493f45269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd7cc0a-455b-4a2e-a1d8-6738ea88642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Volume 00cee54f-7095-41de-adf9-8140e3e48681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cee54f-7095-41de-adf9-8140e3e48681', 'volume_size': 1} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188647151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cee54f-7095-41de-adf9-8140e3e48681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed37cb2fb424145a2c072cd22a15c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:03Z,use_quota=True,user_id='38ac7e465b99434ab961cea5936262f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Creating volume 00cee54f-7095-41de-adf9-8140e3e48681 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:03 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:03 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 1073741824 Jul 06 10:29:03 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:03 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 1073741824" returned: 0 in 0.766s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:03 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 Jul 06 10:29:03 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:04 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681" returned: 0 in 0.608s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd7cc0a-455b-4a2e-a1d8-6738ea88642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cee54f-7095-41de-adf9-8140e3e48681', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d0aea6-1648-46fe-b5ef-1d5ec0e0b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Volume volume-00cee54f-7095-41de-adf9-8140e3e48681 (00cee54f-7095-41de-adf9-8140e3e48681): created successfully Jul 06 10:29:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d0aea6-1648-46fe-b5ef-1d5ec0e0b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Flow 'volume_create_manager' (71761c7a-ff69-4648-8445-59842641e089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ed2c2943-d57e-4b2f-93f2-9ebe7bb7b2d0 tempest-ProjectReaderTests-1728716315 None] Created volume successfully. Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "cinder-00cee54f-7095-41de-adf9-8140e3e48681-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-00cee54f-7095-41de-adf9-8140e3e48681-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "cinder-quobyte-00cee54f-7095-41de-adf9-8140e3e48681" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-quobyte-00cee54f-7095-41de-adf9-8140e3e48681" acquired by "delete_volume" :: waited 0.012s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c272303-5218-4041-a10c-666cf106d8ba]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:05 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 Jul 06 10:29:05 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:05 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681" returned: 0 in 0.704s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:05 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681 Jul 06 10:29:05 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:06 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00cee54f-7095-41de-adf9-8140e3e48681" returned: 0 in 0.601s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-quobyte-00cee54f-7095-41de-adf9-8140e3e48681" released by "delete_volume" :: held 1.345s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Created reservations ['82b4795b-b86a-4817-9ead-6634e61672fb', '7246f5c4-74c5-4aac-98f1-6027fb5e6361', '6b886694-c23a-424a-aec6-012240ae5c26', '6d831960-af02-407e-bcdf-a934d88ec9f3'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:06 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:06 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:07 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.615s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:07 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Deleted volume successfully. Jul 06 10:29:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f57459af-24ca-4930-b8d4-7cc146437d34 tempest-ProjectReaderTests-1728716315 None] Lock "cinder-00cee54f-7095-41de-adf9-8140e3e48681-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:16 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=15,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:29:17 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=3,cinder:SELECT=13 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (ff4d73ef-9b02-47eb-86c7-5432421fd610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cb8a6a-ee9f-4611-b5e4-5d942af7c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cb8a6a-ee9f-4611-b5e4-5d942af7c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1144820115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cf5b5c-d814-4264-991a-c3d930afeda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:19Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf3db16-4705-463f-a19e-74c143618788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf3db16-4705-463f-a19e-74c143618788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2901918d-817d-4787-910d-83f77e4f8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2901918d-817d-4787-910d-83f77e4f8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0cf5b5c-d814-4264-991a-c3d930afeda5', 'volume_name': 'volume-b0cf5b5c-d814-4264-991a-c3d930afeda5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19db4cd-2d5b-411a-832f-dc154d4c3d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19db4cd-2d5b-411a-832f-dc154d4c3d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193306b8-8013-4dd8-aad9-ec219e7a20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Volume b0cf5b5c-d814-4264-991a-c3d930afeda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0cf5b5c-d814-4264-991a-c3d930afeda5', 'volume_size': 1} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1144820115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cf5b5c-d814-4264-991a-c3d930afeda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:19Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Creating volume b0cf5b5c-d814-4264-991a-c3d930afeda5 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:19 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:19 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 1073741824 Jul 06 10:29:19 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (6039aaea-3d5f-4deb-8618-148f5c258ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c2cc88-ebdd-4cca-a495-6640c8c2aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c2cc88-ebdd-4cca-a495-6640c8c2aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404520838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f4d276-007d-4e35-b96d-77bf63f8137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:19Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ecc76c-50d7-4392-90a3-c3b683ab0779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ecc76c-50d7-4392-90a3-c3b683ab0779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a06ab12-f86d-442d-a6dc-12f49e1804d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a06ab12-f86d-442d-a6dc-12f49e1804d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f4d276-007d-4e35-b96d-77bf63f8137e', 'volume_name': 'volume-64f4d276-007d-4e35-b96d-77bf63f8137e', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cdfd65-37f9-4305-8385-56f4323128b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18cdfd65-37f9-4305-8385-56f4323128b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9910a15c-4ba7-4ae9-bc3b-fdccd1b37a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume 64f4d276-007d-4e35-b96d-77bf63f8137e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f4d276-007d-4e35-b96d-77bf63f8137e', 'volume_size': 1} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (6a6a5aa1-2303-4d69-a55b-1787eee40ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c9f4e5-aa8a-400d-93e3-8a27287784ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c9f4e5-aa8a-400d-93e3-8a27287784ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234983970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69fa0a2-3c36-4bdd-b084-f05d81212ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:20Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99484d9b-5f24-402f-ad8f-118ecd5569ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99484d9b-5f24-402f-ad8f-118ecd5569ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfaf584-2885-415c-b1c2-5268ca573784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cfaf584-2885-415c-b1c2-5268ca573784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69fa0a2-3c36-4bdd-b084-f05d81212ce7', 'volume_name': 'volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66c0486-bd95-4c3c-983c-9447d801c2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66c0486-bd95-4c3c-983c-9447d801c2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23682e31-397d-4db6-b03d-cfd523919019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:19 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Volume b69fa0a2-3c36-4bdd-b084-f05d81212ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7', 'volume_size': 1} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:19 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (31e46dd6-d2fe-4725-a652-e4311f7cc1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea52107f-4874-4c8e-a9dc-39a5f987c696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea52107f-4874-4c8e-a9dc-39a5f987c696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-682452305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6b2776-4484-45d4-8176-c2e23db30b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:20Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f427ca-dbbf-4ad3-8a9c-1171de6ebcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f427ca-dbbf-4ad3-8a9c-1171de6ebcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4d2000-7ec0-4a3a-8b31-0b3f808780d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4d2000-7ec0-4a3a-8b31-0b3f808780d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6b2776-4484-45d4-8176-c2e23db30b86', 'volume_name': 'volume-5b6b2776-4484-45d4-8176-c2e23db30b86', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac89144a-51b6-4185-aec4-a790506cae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac89144a-51b6-4185-aec4-a790506cae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b811e3f-03c7-4272-bf90-71616e91c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume 5b6b2776-4484-45d4-8176-c2e23db30b86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6b2776-4484-45d4-8176-c2e23db30b86', 'volume_size': 1} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (39414ea9-2af8-4f07-a16a-7cb7a2bf6ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6eea50-3e03-425a-b3a9-209e155b78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6eea50-3e03-425a-b3a9-209e155b78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768129777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1e3886-a001-46c4-aec2-555553b28caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:20Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449baada-2211-46f9-9caf-19d3bc31ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (449baada-2211-46f9-9caf-19d3bc31ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2b378b-178d-4321-b959-3bad78676890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2b378b-178d-4321-b959-3bad78676890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1e3886-a001-46c4-aec2-555553b28caa', 'volume_name': 'volume-fb1e3886-a001-46c4-aec2-555553b28caa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2c7552-e990-4598-9635-fe1890ae2487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d2c7552-e990-4598-9635-fe1890ae2487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b537f2-970c-44b9-be6c-b8861884df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Volume fb1e3886-a001-46c4-aec2-555553b28caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1e3886-a001-46c4-aec2-555553b28caa', 'volume_size': 1} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:20 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 1073741824" returned: 0 in 1.139s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:20 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 Jul 06 10:29:20 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (b2acb8be-1fc7-462c-b00b-7b970418126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a151d426-d224-41e0-a93f-af37365db182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a151d426-d224-41e0-a93f-af37365db182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102329439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cd1beb-cac4-4eaa-8660-35428206a62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:21Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdebd6de-c730-473f-a561-507300f67a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdebd6de-c730-473f-a561-507300f67a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5bfaea-6b71-40a9-b777-5a03365a3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5bfaea-6b71-40a9-b777-5a03365a3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cd1beb-cac4-4eaa-8660-35428206a62e', 'volume_name': 'volume-59cd1beb-cac4-4eaa-8660-35428206a62e', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a73999a-2e6e-4219-b91d-f3f1b4d7c6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a73999a-2e6e-4219-b91d-f3f1b4d7c6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4c546a-4683-4e99-a1bf-07e819b0b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:20 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Volume 59cd1beb-cac4-4eaa-8660-35428206a62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cd1beb-cac4-4eaa-8660-35428206a62e', 'volume_size': 1} Jul 06 10:29:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (24d50f7b-a5aa-4300-9ad8-6eaef29f4c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3889565d-4f3c-4fc5-86bc-3b2e286a2fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3889565d-4f3c-4fc5-86bc-3b2e286a2fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166327590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5967d9-64d1-4b40-acaa-e441a1a648ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:21Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a04c52-a405-42d4-8b85-f5d87f3feb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a04c52-a405-42d4-8b85-f5d87f3feb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345361e-0db7-4d34-99ae-a1366fa71bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2345361e-0db7-4d34-99ae-a1366fa71bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5967d9-64d1-4b40-acaa-e441a1a648ca', 'volume_name': 'volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3bdee3-b20a-421a-833e-9e22e8b23532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3bdee3-b20a-421a-833e-9e22e8b23532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9540ce1b-3e51-4fc7-804e-e6f883c57635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Volume bf5967d9-64d1-4b40-acaa-e441a1a648ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca', 'volume_size': 1} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:21 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5" returned: 0 in 0.717s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.641s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404520838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f4d276-007d-4e35-b96d-77bf63f8137e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:19Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Creating volume 64f4d276-007d-4e35-b96d-77bf63f8137e {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:21 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193306b8-8013-4dd8-aad9-ec219e7a20f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0cf5b5c-d814-4264-991a-c3d930afeda5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:21 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e 1073741824 Jul 06 10:29:21 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed2fad6-0174-4bce-a67f-9371a25563a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:21 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Volume volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 (b0cf5b5c-d814-4264-991a-c3d930afeda5): created successfully Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed2fad6-0174-4bce-a67f-9371a25563a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:21 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (ff4d73ef-9b02-47eb-86c7-5432421fd610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-24f24080-a19b-49de-8bc3-f22df63d19ef tempest-CreateVolumesFromImageTest-1814247883 None] Created volume successfully. Jul 06 10:29:22 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e 1073741824" returned: 0 in 0.880s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:22 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e Jul 06 10:29:22 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:22 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e" returned: 0 in 0.650s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234983970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69fa0a2-3c36-4bdd-b084-f05d81212ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:20Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Creating volume b69fa0a2-3c36-4bdd-b084-f05d81212ce7 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:22 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:22 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 1073741824 Jul 06 10:29:22 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9910a15c-4ba7-4ae9-bc3b-fdccd1b37a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f4d276-007d-4e35-b96d-77bf63f8137e', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9084fd7c-2656-4e30-993b-c77f6de3ef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:22 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume volume-64f4d276-007d-4e35-b96d-77bf63f8137e (64f4d276-007d-4e35-b96d-77bf63f8137e): created successfully Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9084fd7c-2656-4e30-993b-c77f6de3ef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:22 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (6039aaea-3d5f-4deb-8618-148f5c258ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:22 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-79b39e0e-e9e0-4df3-a126-563507399faf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created volume successfully. Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Flow 'volume_create_manager' (962ae07e-ac51-4b1d-b744-d48cc7e6a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57540ea-66c6-4e83-ac31-7cd53d0be1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57540ea-66c6-4e83-ac31-7cd53d0be1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3077844a71f34c80b235266bba4adf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:23Z,use_quota=True,user_id='05c8ce76ff4b4e82b0b513661689c740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5edf021-3cbe-4637-a793-757ee2cfb91b),volume_type_id=e5edf021-3cbe-4637-a793-757ee2cfb91b)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0a12bf-c72a-42fd-a982-688aab6c7690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0a12bf-c72a-42fd-a982-688aab6c7690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe404e3-388b-447a-8c2d-97718e50d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffe404e3-388b-447a-8c2d-97718e50d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5', 'volume_name': 'volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5', 'volume_size': 1, 'image_id': '7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d4fba31a1d0ec93a764b833d6b902cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3077844a71f34c80b235266bba4adf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14526cfbaccfded13238a526b22a05fa0968d4b5d0913007f7e9fa66c0ac7a95b125fd1117c22da0c71e193f5bb5499b96431105f704a7509811e8090744f05c', 'id': '7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'created_at': datetime.datetime(2026, 7, 6, 8, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c6aef3-7bc2-4555-909a-96c329446d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c6aef3-7bc2-4555-909a-96c329446d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112c0719-11f0-4b0d-9666-17889140894b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Volume c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5', 'volume_size': 1, 'image_id': '7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d4fba31a1d0ec93a764b833d6b902cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3077844a71f34c80b235266bba4adf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14526cfbaccfded13238a526b22a05fa0968d4b5d0913007f7e9fa66c0ac7a95b125fd1117c22da0c71e193f5bb5499b96431105f704a7509811e8090744f05c', 'id': '7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'created_at': datetime.datetime(2026, 7, 6, 8, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Trying to clone c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 from image 7a02b42d-0b19-47a8-acad-9b18b9ef60ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:29:23 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Image download 0.00 MB at 0.00 MB/s Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8dc13d-ec16-4b12-a536-64f2f72c1f9d]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:23 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD Jul 06 10:29:23 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:23 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 1073741824" returned: 0 in 0.952s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:23 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 Jul 06 10:29:23 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (a968d4d0-1836-403a-9635-a525530af4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb58254-ed82-4e0e-9514-9f1cbc446c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb58254-ed82-4e0e-9514-9f1cbc446c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517766991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054c18c7-f710-40e5-8c65-3ccd27d8286c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:24Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fe2f72-737d-4821-af15-6c09503210b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fe2f72-737d-4821-af15-6c09503210b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12e461f-75af-4431-8367-74f6871d7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12e461f-75af-4431-8367-74f6871d7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '054c18c7-f710-40e5-8c65-3ccd27d8286c', 'volume_name': 'volume-054c18c7-f710-40e5-8c65-3ccd27d8286c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88294964-14cf-47af-8b67-94f682cfa703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88294964-14cf-47af-8b67-94f682cfa703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f378df-e428-4de4-8273-39968631e189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume 054c18c7-f710-40e5-8c65-3ccd27d8286c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-054c18c7-f710-40e5-8c65-3ccd27d8286c', 'volume_size': 1} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:24 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD" returned: 0 in 0.780s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:24 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD Jul 06 10:29:24 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:24 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (a18df8ff-0fdd-4a83-824e-27831345416f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db867e73-049b-4bf2-817a-ed819df616e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7" returned: 0 in 0.796s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.448s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-682452305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6b2776-4484-45d4-8176-c2e23db30b86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:20Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Creating volume 5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:24 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db867e73-049b-4bf2-817a-ed819df616e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537643846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394e2d50-74d7-4324-b9f0-3afd5a66c7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:25Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 1073741824 Jul 06 10:29:24 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b621de73-1092-4e30-8901-1c6451b96ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b621de73-1092-4e30-8901-1c6451b96ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4d58fc-52c9-4812-abae-12f59861b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4d58fc-52c9-4812-abae-12f59861b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394e2d50-74d7-4324-b9f0-3afd5a66c7bf', 'volume_name': 'volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27180b0-741f-48c6-8b63-01e2e8938c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27180b0-741f-48c6-8b63-01e2e8938c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deba035b-8e4d-4a1f-a49a-4854c1472abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume 394e2d50-74d7-4324-b9f0-3afd5a66c7bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf', 'volume_size': 1} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23682e31-397d-4db6-b03d-cfd523919019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594e7f27-540e-4769-a55f-733ce8155442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:24 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Volume volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 (b69fa0a2-3c36-4bdd-b084-f05d81212ce7): created successfully Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (594e7f27-540e-4769-a55f-733ce8155442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (6a6a5aa1-2303-4d69-a55b-1787eee40ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:24 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ab3d5648-1dd8-4112-a807-381556ea7441 tempest-CreateVolumesFromImageTest-1814247883 None] Created volume successfully. Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (a509cc0b-f089-463a-a16a-1c610628f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280ab097-f2cc-43a1-9a65-dd13a190cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280ab097-f2cc-43a1-9a65-dd13a190cd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365360830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958b5a14-4847-4d90-8cdf-161cc64a3ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:25Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddda7f0-0197-4595-b936-1ec0917a32d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddda7f0-0197-4595-b936-1ec0917a32d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf3c04c-b5a3-4f7d-92c9-faf12c79b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf3c04c-b5a3-4f7d-92c9-faf12c79b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '958b5a14-4847-4d90-8cdf-161cc64a3ff5', 'volume_name': 'volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0b44e1-0f12-40a9-a7c3-aaf36421c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0b44e1-0f12-40a9-a7c3-aaf36421c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df3aa1-62db-42a9-b4c3-deed6a0797ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume 958b5a14-4847-4d90-8cdf-161cc64a3ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5', 'volume_size': 1} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD" returned: 1 in 0.897s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Temporary image 7a02b42d-0b19-47a8-acad-9b18b9ef60ef is fetched for user 05c8ce76ff4b4e82b0b513661689c740. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1468a7cb-7e70-4f75-a087-148d10b4b60e]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (6adc9911-5015-40ba-8407-6c8e3b9342ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69354f1d-4130-46dc-a132-09244eb3b6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69354f1d-4130-46dc-a132-09244eb3b6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531760755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e3ffe6-54ef-4072-b13f-97650ecb674b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:25Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a25a3c8-395c-4b69-b5d3-c344a37a8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a25a3c8-395c-4b69-b5d3-c344a37a8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79c622c-210d-48fb-8d1b-9a3e30e25a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79c622c-210d-48fb-8d1b-9a3e30e25a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e3ffe6-54ef-4072-b13f-97650ecb674b', 'volume_name': 'volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdfe589-0608-4682-9d03-3b8ce9841817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fdfe589-0608-4682-9d03-3b8ce9841817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c4224a-479a-4c26-85b3-3be1c7596928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume d8e3ffe6-54ef-4072-b13f-97650ecb674b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b', 'volume_size': 1} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:25 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD Jul 06 10:29:25 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:25 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 1073741824" returned: 0 in 1.171s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (81310cc0-0d44-402b-8af3-608832fdeecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de15c06b-6e63-4653-acaa-b758074f0f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de15c06b-6e63-4653-acaa-b758074f0f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861326455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7541696-9329-4aa1-96b9-31fba740d653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:26Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb96f968-ef33-4408-af98-a9fb1de95d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb96f968-ef33-4408-af98-a9fb1de95d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9312d30-8f55-49eb-b1ef-6cdb2485d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9312d30-8f55-49eb-b1ef-6cdb2485d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7541696-9329-4aa1-96b9-31fba740d653', 'volume_name': 'volume-e7541696-9329-4aa1-96b9-31fba740d653', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba591ced-c1a6-4010-9d6f-738339d6135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba591ced-c1a6-4010-9d6f-738339d6135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fa079b-3992-4568-afa9-212989d7e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume e7541696-9329-4aa1-96b9-31fba740d653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7541696-9329-4aa1-96b9-31fba740d653', 'volume_size': 1} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:25 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 Jul 06 10:29:25 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:26 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD" returned: 0 in 0.880s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:26 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD Jul 06 10:29:26 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:26 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86" returned: 0 in 0.641s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.259s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768129777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1e3886-a001-46c4-aec2-555553b28caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:20Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Creating volume fb1e3886-a001-46c4-aec2-555553b28caa {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:26 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:26 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa 1073741824 Jul 06 10:29:26 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b811e3f-03c7-4272-bf90-71616e91c964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6b2776-4484-45d4-8176-c2e23db30b86', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e64f56-d9ae-41c9-b1ca-93eef9813656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:26 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume volume-5b6b2776-4484-45d4-8176-c2e23db30b86 (5b6b2776-4484-45d4-8176-c2e23db30b86): created successfully Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e64f56-d9ae-41c9-b1ca-93eef9813656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (31e46dd6-d2fe-4725-a652-e4311f7cc1a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:26 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3fe59eee-44a8-4093-9d0c-db7fadae7545 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created volume successfully. Jul 06 10:29:26 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD" returned: 1 in 0.711s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:29:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:27 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa 1073741824" returned: 0 in 0.787s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:27 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa Jul 06 10:29:27 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:28 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa" returned: 0 in 0.626s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.143s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2102329439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cd1beb-cac4-4eaa-8660-35428206a62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:21Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Creating volume 59cd1beb-cac4-4eaa-8660-35428206a62e {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:28 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:28 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e 1073741824 Jul 06 10:29:28 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b537f2-970c-44b9-be6c-b8861884df5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1e3886-a001-46c4-aec2-555553b28caa', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740ca0a9-a923-4467-823f-30c62423e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:28 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Volume volume-fb1e3886-a001-46c4-aec2-555553b28caa (fb1e3886-a001-46c4-aec2-555553b28caa): created successfully Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (740ca0a9-a923-4467-823f-30c62423e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (39414ea9-2af8-4f07-a16a-7cb7a2bf6ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:28 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-03e0be24-1fda-49eb-a71f-bcce87928989 tempest-CreateVolumesFromImageTest-1814247883 None] Created volume successfully. Jul 06 10:29:28 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e 1073741824" returned: 0 in 0.877s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:28 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e Jul 06 10:29:28 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:29 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.427s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166327590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5967d9-64d1-4b40-acaa-e441a1a648ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8548ce614aca4bf88955c52104a4669f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:21Z,use_quota=True,user_id='2d81b4cef03b436896c5abb8e1f9e434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Creating volume bf5967d9-64d1-4b40-acaa-e441a1a648ca {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:29 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4c546a-4683-4e99-a1bf-07e819b0b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cd1beb-cac4-4eaa-8660-35428206a62e', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:29 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca 1073741824 Jul 06 10:29:29 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc792a4-691d-4f5a-8db6-c0e979d73de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Volume volume-59cd1beb-cac4-4eaa-8660-35428206a62e (59cd1beb-cac4-4eaa-8660-35428206a62e): created successfully Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc792a4-691d-4f5a-8db6-c0e979d73de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (b2acb8be-1fc7-462c-b00b-7b970418126c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6b0d5e53-07d1-4fa4-8075-e871208ee9ef tempest-CreateVolumesFromImageTest-1814247883 None] Created volume successfully. Jul 06 10:29:30 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca 1073741824" returned: 0 in 0.856s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:30 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca Jul 06 10:29:30 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:31 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca" returned: 0 in 0.700s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.993s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517766991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=054c18c7-f710-40e5-8c65-3ccd27d8286c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:24Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Creating volume 054c18c7-f710-40e5-8c65-3ccd27d8286c {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:31 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9540ce1b-3e51-4fc7-804e-e6f883c57635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:31 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c 1073741824 Jul 06 10:29:31 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3eebfdd-2de1-4e43-8a2c-2a3c179369d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:31 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Volume volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca (bf5967d9-64d1-4b40-acaa-e441a1a648ca): created successfully Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3eebfdd-2de1-4e43-8a2c-2a3c179369d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Flow 'volume_create_manager' (24d50f7b-a5aa-4300-9ad8-6eaef29f4c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2e148dab-a23a-448c-a519-fccd1ccb016f tempest-CreateVolumesFromImageTest-1814247883 None] Created volume successfully. Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-bf5967d9-64d1-4b40-acaa-e441a1a648ca-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-bf5967d9-64d1-4b40-acaa-e441a1a648ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-quobyte-bf5967d9-64d1-4b40-acaa-e441a1a648ca" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-bf5967d9-64d1-4b40-acaa-e441a1a648ca" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:32 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c 1073741824" returned: 0 in 0.888s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a6a66-3d2a-41a1-9d4d-2bbd3e43efc2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:32 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c Jul 06 10:29:32 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:32 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca Jul 06 10:29:32 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:32 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c" returned: 0 in 0.637s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.091s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537643846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394e2d50-74d7-4324-b9f0-3afd5a66c7bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:25Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Creating volume 394e2d50-74d7-4324-b9f0-3afd5a66c7bf {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:32 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:32 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf 1073741824 Jul 06 10:29:32 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f378df-e428-4de4-8273-39968631e189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-054c18c7-f710-40e5-8c65-3ccd27d8286c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c047ce6-7913-409c-93c5-dc16e207df1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:32 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume volume-054c18c7-f710-40e5-8c65-3ccd27d8286c (054c18c7-f710-40e5-8c65-3ccd27d8286c): created successfully Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c047ce6-7913-409c-93c5-dc16e207df1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (a968d4d0-1836-403a-9635-a525530af4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9c523364-45ad-40e3-87c2-0bf8ee110e4c tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created volume successfully. Jul 06 10:29:32 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca" returned: 0 in 0.779s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:32 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca Jul 06 10:29:32 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:33 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bf5967d9-64d1-4b40-acaa-e441a1a648ca" returned: 0 in 0.655s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-bf5967d9-64d1-4b40-acaa-e441a1a648ca" released by "delete_volume" :: held 1.483s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Created reservations ['d0294f91-78e5-40f8-a38d-406ea065e2b7', '39218583-9cac-4f0a-b727-3026d650ad41', '10872cbb-59d5-4ab0-8058-770c9499b45c', 'd305ff1c-714c-4a6d-abea-4d4ea2f19575'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:33 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:33 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:33 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf 1073741824" returned: 0 in 0.948s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:33 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf Jul 06 10:29:33 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-59cd1beb-cac4-4eaa-8660-35428206a62e-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-59cd1beb-cac4-4eaa-8660-35428206a62e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:34 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.644s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Deleted volume successfully. Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-quobyte-59cd1beb-cac4-4eaa-8660-35428206a62e" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-59cd1beb-cac4-4eaa-8660-35428206a62e" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-959c1bb7-b690-4bc2-bc9a-c3c9bcb8de42 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-bf5967d9-64d1-4b40-acaa-e441a1a648ca-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f1475f-98c0-4b31-a1ea-394e8bf99961]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:34 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:34 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e Jul 06 10:29:34 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf" returned: 0 in 0.717s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.264s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1365360830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=958b5a14-4847-4d90-8cdf-161cc64a3ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:25Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Creating volume 958b5a14-4847-4d90-8cdf-161cc64a3ff5 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:34 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deba035b-8e4d-4a1f-a49a-4854c1472abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:34 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 1073741824 Jul 06 10:29:34 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea942016-b87c-4dd4-9093-424b216a6472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf (394e2d50-74d7-4324-b9f0-3afd5a66c7bf): created successfully Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea942016-b87c-4dd4-9093-424b216a6472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (a18df8ff-0fdd-4a83-824e-27831345416f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2819b3eb-4f27-4280-b810-c61124edbd9d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created volume successfully. Jul 06 10:29:35 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e" returned: 0 in 0.800s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:35 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e Jul 06 10:29:35 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:35 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 1073741824" returned: 0 in 0.854s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:35 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 Jul 06 10:29:35 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:35 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-59cd1beb-cac4-4eaa-8660-35428206a62e" returned: 0 in 0.627s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-59cd1beb-cac4-4eaa-8660-35428206a62e" released by "delete_volume" :: held 1.465s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Created reservations ['aeb15892-a64a-4c50-a5b2-2708b0065601', '306b4790-03c9-461b-b7cc-dc6625f53984', '294a353e-faed-4ce5-9ed1-2be5ae2b039a', 'eb23b49e-a096-4489-8409-784c8fae63cc'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:35 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:35 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:36 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.550s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531760755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e3ffe6-54ef-4072-b13f-97650ecb674b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:25Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Creating volume d8e3ffe6-54ef-4072-b13f-97650ecb674b {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:36 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9df3aa1-62db-42a9-b4c3-deed6a0797ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:36 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b 1073741824 Jul 06 10:29:36 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fa5075-ac78-4184-b7c7-a89de0ac4af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:36 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 (958b5a14-4847-4d90-8cdf-161cc64a3ff5): created successfully Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fa5075-ac78-4184-b7c7-a89de0ac4af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (a509cc0b-f089-463a-a16a-1c610628f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e790a5f8-9ab8-4954-a5c7-9a189a9c8963 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created volume successfully. Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-fb1e3886-a001-46c4-aec2-555553b28caa-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-fb1e3886-a001-46c4-aec2-555553b28caa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:36 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.640s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-quobyte-fb1e3886-a001-46c4-aec2-555553b28caa" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Deleted volume successfully. Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-fb1e3886-a001-46c4-aec2-555553b28caa" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cdfd0f5d-4185-4e9f-85b7-ce30834f0ef7 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-59cd1beb-cac4-4eaa-8660-35428206a62e-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf69115e-4a59-4625-a390-be308758e714]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:36 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa Jul 06 10:29:36 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:37 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b 1073741824" returned: 0 in 0.899s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:37 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b Jul 06 10:29:37 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:37 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:37 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa Jul 06 10:29:37 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:37 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b" returned: 0 in 0.676s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.822s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861326455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7541696-9329-4aa1-96b9-31fba740d653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048c8eb182494685bb9477db6486d344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:26Z,use_quota=True,user_id='311d30503746410daa9d29465a299414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Creating volume e7541696-9329-4aa1-96b9-31fba740d653 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:37 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:37 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 1073741824 Jul 06 10:29:37 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33c4224a-479a-4c26-85b3-3be1c7596928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5badbe-f8ee-4f50-a7b1-108d15459a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b (d8e3ffe6-54ef-4072-b13f-97650ecb674b): created successfully Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5badbe-f8ee-4f50-a7b1-108d15459a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (6adc9911-5015-40ba-8407-6c8e3b9342ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7882cddc-6ae1-4f29-8b35-426c2ee725d9 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created volume successfully. Jul 06 10:29:38 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-fb1e3886-a001-46c4-aec2-555553b28caa" returned: 0 in 0.649s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-fb1e3886-a001-46c4-aec2-555553b28caa" released by "delete_volume" :: held 1.478s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Created reservations ['3ff4fb89-832a-46b2-a17a-286c8fc41d39', '6f402f36-627c-4934-9fdc-686a7a6cde75', 'bafc3adb-e8cb-495a-9ff4-ebe0f933dc98', 'c4d31b76-f7dd-403a-bc80-2b18c3fb2692'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:38 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:38 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:38 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 1073741824" returned: 0 in 0.820s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:38 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 Jul 06 10:29:38 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-b69fa0a2-3c36-4bdd-b084-f05d81212ce7-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-b69fa0a2-3c36-4bdd-b084-f05d81212ce7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:38 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.648s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:38 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Deleted volume successfully. Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-quobyte-b69fa0a2-3c36-4bdd-b084-f05d81212ce7" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-b69fa0a2-3c36-4bdd-b084-f05d81212ce7" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9b366aa9-40ce-4c4c-a425-f0010c1d99f8 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-fb1e3886-a001-46c4-aec2-555553b28caa-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f97add-39bb-4709-a228-28e5ecb38c19]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:39 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 Jul 06 10:29:39 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:39 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653" returned: 0 in 0.698s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.370s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3077844a71f34c80b235266bba4adf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:23Z,use_quota=True,user_id='05c8ce76ff4b4e82b0b513661689c740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5edf021-3cbe-4637-a793-757ee2cfb91b),volume_type_id=e5edf021-3cbe-4637-a793-757ee2cfb91b)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Creating volume c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:39 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fa079b-3992-4568-afa9-212989d7e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7541696-9329-4aa1-96b9-31fba740d653', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:39 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 1073741824 Jul 06 10:29:39 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35dcc33-78c0-4f19-8ee1-a9641d0fee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Volume volume-e7541696-9329-4aa1-96b9-31fba740d653 (e7541696-9329-4aa1-96b9-31fba740d653): created successfully Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35dcc33-78c0-4f19-8ee1-a9641d0fee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Flow 'volume_create_manager' (81310cc0-0d44-402b-8af3-608832fdeecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-aa1f396b-fbf0-40e5-9a07-874241d8801d tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created volume successfully. Jul 06 10:29:39 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7" returned: 0 in 0.794s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:39 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7 Jul 06 10:29:39 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-e7541696-9329-4aa1-96b9-31fba740d653-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-e7541696-9329-4aa1-96b9-31fba740d653-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-quobyte-e7541696-9329-4aa1-96b9-31fba740d653" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-e7541696-9329-4aa1-96b9-31fba740d653" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1793efd6-8868-4230-9539-bb8afcc654ad]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:40 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 Jul 06 10:29:40 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:40 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 1073741824" returned: 0 in 0.941s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:40 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 Jul 06 10:29:40 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:40 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b69fa0a2-3c36-4bdd-b084-f05d81212ce7" returned: 0 in 0.753s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-b69fa0a2-3c36-4bdd-b084-f05d81212ce7" released by "delete_volume" :: held 1.593s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Created reservations ['81485a49-094f-4975-a5ae-17db81c77831', 'a292bf74-b57a-48b4-81fa-47b1d2fb4fb3', '572a734b-b4e0-40f4-9441-50faf3eab908', '28719cff-01af-4c8b-a6c1-b801a49e7651'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:40 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:40 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:40 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:40 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653 Jul 06 10:29:40 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:40 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" returned: 0 in 0.683s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.386s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Creating offline snapshot 1662895e-4bb4-408d-9496-716fddf9d7a0 of volume 5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Attempting download of 7a02b42d-0b19-47a8-acad-9b18b9ef60ef ((None, [{'url': 'file:///opt/stack/data/glance/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'metadata': {}}])) to volume c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f92e1d-02d9-4d93-9a9f-f790c9dd2bc0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-b0cf5b5c-d814-4264-991a-c3d930afeda5-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1628a3a8-0322-4e7a-81a3-d24d3bc6da6c]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_f67api5e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-b0cf5b5c-d814-4264-991a-c3d930afeda5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "cinder-quobyte-b0cf5b5c-d814-4264-991a-c3d930afeda5" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-b0cf5b5c-d814-4264-991a-c3d930afeda5" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:41 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 Jul 06 10:29:41 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bda122-00e4-4ea0-894b-33fccd018e33]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:41 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_f67api5e Jul 06 10:29:41 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:41 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.864s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:41 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 Jul 06 10:29:41 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Deleted volume successfully. Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f1e1fca7-2825-48f1-b1e1-03105aad362d tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-b69fa0a2-3c36-4bdd-b084-f05d81212ce7-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:41 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e7541696-9329-4aa1-96b9-31fba740d653" returned: 0 in 0.845s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-e7541696-9329-4aa1-96b9-31fba740d653" released by "delete_volume" :: held 1.668s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created reservations ['1d38aabe-fa80-457c-be51-310d86315765', 'bc990db1-2702-4962-90c1-0e3cadb1c17f', '4f9722af-ac21-4099-ad5e-df5a0fe0cc07', '7fb0626f-9c8e-48f7-89d3-79bbaf0098d1'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:41 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:41 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:42 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_f67api5e" returned: 0 in 0.868s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_f67api5e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:42 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86" returned: 0 in 1.013s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:42 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 1G Jul 06 10:29:42 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-d8e3ffe6-54ef-4072-b13f-97650ecb674b-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:42 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_f67api5e Jul 06 10:29:42 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-d8e3ffe6-54ef-4072-b13f-97650ecb674b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:42 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5" returned: 0 in 1.041s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-quobyte-d8e3ffe6-54ef-4072-b13f-97650ecb674b" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:42 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5 Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-d8e3ffe6-54ef-4072-b13f-97650ecb674b" acquired by "delete_volume" :: waited 0.039s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:42 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e05020-853c-4908-a261-0b5b477fe3e8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:42 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b Jul 06 10:29:42 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:42 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.919s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:42 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Deleted volume successfully. Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-40305a91-56da-449f-82cf-02753e807fcc tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-e7541696-9329-4aa1-96b9-31fba740d653-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:42 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_f67api5e" returned: 1 in 0.890s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_f67api5e' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f367f7-2d46-4212-bc3f-a4033dac3917]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:43 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD Jul 06 10:29:43 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:43 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b0cf5b5c-d814-4264-991a-c3d930afeda5" returned: 0 in 0.762s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-quobyte-b0cf5b5c-d814-4264-991a-c3d930afeda5" released by "delete_volume" :: held 1.855s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:43 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 1G" returned: 0 in 1.156s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b6b2776-4484-45d4-8176-c2e23db30b86 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Created reservations ['31a97fa5-6ad1-49e0-97a2-7b93f7dc551b', 'def17f95-f985-465a-9641-507f74abc712', 'c4373992-a00a-4e92-bcc8-3e9c9be628d8', 'bd902d8a-a98a-4441-b8bc-c7ede6263c64'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:43 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b6b2776-4484-45d4-8176-c2e23db30b86 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 Jul 06 10:29:43 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:43 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:43 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:43 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b" returned: 0 in 1.092s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:43 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b Jul 06 10:29:43 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:43 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD" returned: 0 in 0.992s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:44 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b6b2776-4484-45d4-8176-c2e23db30b86 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0" returned: 0 in 0.914s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:44 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 is being set with open permissions: ugo+rw Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:44 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD Jul 06 10:29:44 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:44 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 Jul 06 10:29:44 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:44 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.942s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Deleted volume successfully. Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b976243f-4610-43cb-a6c1-c29d47b25965 tempest-CreateVolumesFromImageTest-1814247883 None] Lock "cinder-b0cf5b5c-d814-4264-991a-c3d930afeda5-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:44 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d8e3ffe6-54ef-4072-b13f-97650ecb674b" returned: 0 in 0.970s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-d8e3ffe6-54ef-4072-b13f-97650ecb674b" released by "delete_volume" :: held 2.126s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created reservations ['d3b3339b-8e70-4789-8bd9-4c48b9de22b3', '02c35564-3ef5-4d46-9804-127000d2c2d6', '5da109a9-245e-4862-ac80-cb101a7d8092', '2496c125-290b-49ba-a80b-1ee94b4ea230'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:44 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:44 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:44 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD" returned: 1 in 1.042s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] 7a02b42d-0b19-47a8-acad-9b18b9ef60ef was raw, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:29:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:45 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 Jul 06 10:29:45 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:45 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0" returned: 0 in 0.947s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:45 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.info Jul 06 10:29:45 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:45 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.869s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Deleted volume successfully. Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-fee2385a-c804-4a95-93ee-fc23d7977d90 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-d8e3ffe6-54ef-4072-b13f-97650ecb674b-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-958b5a14-4847-4d90-8cdf-161cc64a3ff5-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-958b5a14-4847-4d90-8cdf-161cc64a3ff5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-quobyte-958b5a14-4847-4d90-8cdf-161cc64a3ff5" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-958b5a14-4847-4d90-8cdf-161cc64a3ff5" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4afdbcc-075b-4254-b08d-1cf00f0d9324]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:45 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 Jul 06 10:29:45 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" returned: 0 in 1.015s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:45 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a02b42d-0b19-47a8-acad-9b18b9ef60ef_pv7zj8d5devstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:29:45 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 10:29:45 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:46 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 1G Jul 06 10:29:46 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:46 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.info" returned: 0 in 0.943s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:46 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.info is being set with open permissions: ugo+rw Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:46 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.info Jul 06 10:29:46 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:46 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:46 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 1G" returned: 0 in 0.816s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5" returned: 0 in 0.950s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:46 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5 Jul 06 10:29:46 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e78f5b6-6736-4d30-9223-9cb070fe6dad]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:46 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.info" returned: 0 in 0.826s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.963s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-feffc859-94fa-4355-8a70-0d0f0a88a37c tempest-CreateVolumesFromSnapshotTest-352676270 None] Create snapshot completed successfully Jul 06 10:29:46 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 Jul 06 10:29:46 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:47 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-958b5a14-4847-4d90-8cdf-161cc64a3ff5" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-958b5a14-4847-4d90-8cdf-161cc64a3ff5" released by "delete_volume" :: held 1.787s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created reservations ['5c541e6a-f1f4-49a5-8fcf-e3ea8643ddab', '57fcdc4f-9c68-4dcc-ba0d-55931fc79049', 'bc8b6b45-d9d4-4fbd-9859-7a71b3f4316f', '14ca1690-0f2b-4b2d-9444-7ab8c579b5c0'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:47 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" returned: 0 in 0.843s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:47 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 Jul 06 10:29:47 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:47 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:47 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (96c31769-f891-43ed-8d22-046fdc9d4fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b25548-3cdc-45f4-8733-70b48e9aa30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-44b202fa-a22e-4ddd-b8ff-0fa96e1c8aff tempest-ProjectAdminTests-1366764791 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6445007324219, 'free_capacity_gb': 1775.6445007324219, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86456) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b25548-3cdc-45f4-8733-70b48e9aa30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-782915659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff47e12-bafb-4af1-9ff2-d5941ba770de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:48Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec837b4-c7e7-4f07-9abe-3b1f0ae35867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec837b4-c7e7-4f07-9abe-3b1f0ae35867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5f69f5-1a0a-4c5e-9b27-bb0276735167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5f69f5-1a0a-4c5e-9b27-bb0276735167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bff47e12-bafb-4af1-9ff2-d5941ba770de', 'volume_name': 'volume-bff47e12-bafb-4af1-9ff2-d5941ba770de', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecccdaef-eb88-4e3a-b056-f2d9b72f8276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecccdaef-eb88-4e3a-b056-f2d9b72f8276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b27748-d3ae-42bc-b78b-0e793a8ec6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:48 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume bff47e12-bafb-4af1-9ff2-d5941ba770de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bff47e12-bafb-4af1-9ff2-d5941ba770de', 'volume_size': 1} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-782915659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bff47e12-bafb-4af1-9ff2-d5941ba770de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:48Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Creating volume bff47e12-bafb-4af1-9ff2-d5941ba770de {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:48 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:48 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de 1073741824 Jul 06 10:29:48 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-394e2d50-74d7-4324-b9f0-3afd5a66c7bf-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-394e2d50-74d7-4324-b9f0-3afd5a66c7bf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-quobyte-394e2d50-74d7-4324-b9f0-3afd5a66c7bf" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-394e2d50-74d7-4324-b9f0-3afd5a66c7bf" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd85259-4ee1-45b7-bf49-409c839a9739]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:48 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf Jul 06 10:29:48 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:48 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (a206f283-de3d-412a-a9aa-af34ff025136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a2e954-655a-4ac7-baec-2bc6a76ebe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" returned: 1 in 1.206s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Downloaded image 7a02b42d-0b19-47a8-acad-9b18b9ef60ef ((None, [{'url': 'file:///opt/stack/data/glance/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'metadata': {}}])) to volume c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Temporary image 7a02b42d-0b19-47a8-acad-9b18b9ef60ef for user 05c8ce76ff4b4e82b0b513661689c740 is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Marking volume c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:29:48 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.144s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a2e954-655a-4ac7-baec-2bc6a76ebe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2053253709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb3bac7-06c5-42bb-af26-942c0cbe6034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:49Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b23b7bd-1aa4-4aa6-a83a-b5f4be7f4328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:48 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b23b7bd-1aa4-4aa6-a83a-b5f4be7f4328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf74bd88-1483-4ae3-83d0-966cfae0b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf74bd88-1483-4ae3-83d0-966cfae0b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb3bac7-06c5-42bb-af26-942c0cbe6034', 'volume_name': 'volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d222c29-a0e0-437b-80e7-11b50038dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d222c29-a0e0-437b-80e7-11b50038dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8044c339-af20-42b9-a660-e2010874f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume 1bb3bac7-06c5-42bb-af26-942c0cbe6034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034', 'volume_size': 1} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Deleted volume successfully. Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Copying metadata from image 7a02b42d-0b19-47a8-acad-9b18b9ef60ef to c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Creating volume glance metadata for volume c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 backed by image 7a02b42d-0b19-47a8-acad-9b18b9ef60ef with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9d4fba31a1d0ec93a764b833d6b902cc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cc5f6b6-4395-4406-a6a4-46bdba3b3594 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-958b5a14-4847-4d90-8cdf-161cc64a3ff5-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112c0719-11f0-4b0d-9666-17889140894b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5', 'volume_size': 1, 'image_id': '7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9d4fba31a1d0ec93a764b833d6b902cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3077844a71f34c80b235266bba4adf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14526cfbaccfded13238a526b22a05fa0968d4b5d0913007f7e9fa66c0ac7a95b125fd1117c22da0c71e193f5bb5499b96431105f704a7509811e8090744f05c', 'id': '7a02b42d-0b19-47a8-acad-9b18b9ef60ef', 'created_at': datetime.datetime(2026, 7, 6, 8, 29, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 29, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a02b42d-0b19-47a8-acad-9b18b9ef60ef/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678aff4e-3900-4a9f-aa09-1bfc4436a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Volume volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 (c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5): created successfully Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (678aff4e-3900-4a9f-aa09-1bfc4436a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Flow 'volume_create_manager' (962ae07e-ac51-4b1d-b744-d48cc7e6a842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9aa0fb8e-b657-4574-a604-fe50f8ff2fc7 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Created volume successfully. Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (08d6c22b-0103-4955-889d-7792e3c5e0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13cdd6f-1170-4906-bd65-ff715517275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13cdd6f-1170-4906-bd65-ff715517275e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840055566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a8276-da6c-46b9-a934-6084ee38d74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:49Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9e51e1-9a5f-4e0a-97d3-b939e0ae0f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9e51e1-9a5f-4e0a-97d3-b939e0ae0f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5de8844-55e0-42f5-a19f-00b268175963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5de8844-55e0-42f5-a19f-00b268175963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39a8276-da6c-46b9-a934-6084ee38d74a', 'volume_name': 'volume-d39a8276-da6c-46b9-a934-6084ee38d74a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d09d866-9dd9-4cfb-9bd6-d2f121b3741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d09d866-9dd9-4cfb-9bd6-d2f121b3741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7934f3-25c0-48dd-a788-32cec627fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:49 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume d39a8276-da6c-46b9-a934-6084ee38d74a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39a8276-da6c-46b9-a934-6084ee38d74a', 'volume_size': 1} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de 1073741824" returned: 0 in 1.407s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:49 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de Jul 06 10:29:49 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:49 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf" returned: 0 in 1.338s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:49 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf Jul 06 10:29:49 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (594f9feb-0c3c-40a4-b1e1-6238b31f3bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc24918f-9f14-4741-b431-7d8b4501bb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc24918f-9f14-4741-b431-7d8b4501bb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489257917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:50Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f2748-79a1-407d-9866-21e6c1881dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2f2748-79a1-407d-9866-21e6c1881dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c49a12-7bc5-4426-85bf-45ae22957c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c49a12-7bc5-4426-85bf-45ae22957c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f', 'volume_name': 'volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465f04f4-0810-4997-a470-2323b11c2f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (465f04f4-0810-4997-a470-2323b11c2f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1053edf-83e2-4f07-a1af-669606dd4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume 2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f', 'volume_size': 1} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Acquiring lock "cinder-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "cinder-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Acquiring lock "cinder-quobyte-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "cinder-quobyte-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (298aa565-f3eb-4e59-8be6-94064a82344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4963da5-85d5-4cfc-a753-a2291aaa4eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e72415-c76b-484b-bad3-2d65342fc267]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de" returned: 0 in 1.094s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] <== create_volume: return (2552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.555s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2053253709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb3bac7-06c5-42bb-af26-942c0cbe6034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:49Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Creating volume 1bb3bac7-06c5-42bb-af26-942c0cbe6034 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:50 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4963da5-85d5-4cfc-a753-a2291aaa4eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1172781400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ef4440-a395-4111-8490-fdfcc8801936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:51Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c435d-03bd-4286-a18d-6b0ece1cb333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 1073741824 Jul 06 10:29:50 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c435d-03bd-4286-a18d-6b0ece1cb333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bca78e2-0811-4013-a040-bc80b09f2418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bca78e2-0811-4013-a040-bc80b09f2418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ef4440-a395-4111-8490-fdfcc8801936', 'volume_name': 'volume-44ef4440-a395-4111-8490-fdfcc8801936', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6060c4e2-441f-4af2-8e57-1238fca53a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6060c4e2-441f-4af2-8e57-1238fca53a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfd2df7-048b-4d41-89da-4f9b9f75f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume 44ef4440-a395-4111-8490-fdfcc8801936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ef4440-a395-4111-8490-fdfcc8801936', 'volume_size': 1} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b27748-d3ae-42bc-b78b-0e793a8ec6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bff47e12-bafb-4af1-9ff2-d5941ba770de', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c43616b-c78e-4eb8-a3c7-8274a25bbb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:50 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 Jul 06 10:29:50 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:50 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume volume-bff47e12-bafb-4af1-9ff2-d5941ba770de (bff47e12-bafb-4af1-9ff2-d5941ba770de): created successfully Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c43616b-c78e-4eb8-a3c7-8274a25bbb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:50 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (96c31769-f891-43ed-8d22-046fdc9d4fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:50 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-394e2d50-74d7-4324-b9f0-3afd5a66c7bf" returned: 0 in 1.110s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e23c9a60-c06b-4d8c-a079-4b848a404012 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created volume successfully. Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-394e2d50-74d7-4324-b9f0-3afd5a66c7bf" released by "delete_volume" :: held 2.521s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created reservations ['1fd940fe-1484-421f-a492-81db22a0e2b4', '1c98a243-3815-4c91-85eb-93085d29fca1', '744a1f1d-f07a-4e65-8a38-af21d12a6881', '833063b1-a814-4817-abea-b14abf3e65d5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:51 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:51 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:51 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" returned: 0 in 1.031s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:51 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 Jul 06 10:29:51 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:51 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 1073741824" returned: 0 in 1.228s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:52 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.825s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Deleted volume successfully. Jul 06 10:29:52 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 Jul 06 10:29:52 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-51ed2cfb-fe15-497c-abb6-667782f81016 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-394e2d50-74d7-4324-b9f0-3afd5a66c7bf-delete_volume" released by "delete_volume" :: held 3.716s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-054c18c7-f710-40e5-8c65-3ccd27d8286c-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-054c18c7-f710-40e5-8c65-3ccd27d8286c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-quobyte-054c18c7-f710-40e5-8c65-3ccd27d8286c" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-054c18c7-f710-40e5-8c65-3ccd27d8286c" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd43d5-9d8b-4904-bdd4-38678c6b04c0]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:52 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c Jul 06 10:29:52 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:52 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" returned: 1 in 1.003s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:52 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5 Jul 06 10:29:52 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:52 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034" returned: 0 in 0.834s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.263s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840055566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39a8276-da6c-46b9-a934-6084ee38d74a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:49Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Creating volume d39a8276-da6c-46b9-a934-6084ee38d74a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:52 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8044c339-af20-42b9-a660-e2010874f986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:52 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a 1073741824 Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeef2d0-f158-4ce9-a3e4-a2678927ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:52 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 (1bb3bac7-06c5-42bb-af26-942c0cbe6034): created successfully Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeef2d0-f158-4ce9-a3e4-a2678927ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (a206f283-de3d-412a-a9aa-af34ff025136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d96ae322-66db-45a5-8d0c-cfc90b14c403 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created volume successfully. Jul 06 10:29:53 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c" returned: 0 in 0.885s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:53 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c Jul 06 10:29:53 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:53 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" returned: 0 in 0.767s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "cinder-quobyte-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5" released by "delete_volume" :: held 2.922s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Created reservations ['3bdae07d-093a-48fa-b1fc-4e4ceebc4478', '0dde958c-7ba8-45b3-b86f-e64ff50ddc8d', 'e045b27e-65ec-47aa-9ac0-75bb4dbedc02', 'b06b602e-e07b-4207-8e5f-cdf932a21118'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:53 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:53 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (bb17b373-bd44-4685-9114-eb8617fa0538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be085634-22e1-4ed4-b76b-f2bbfcefbff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be085634-22e1-4ed4-b76b-f2bbfcefbff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703110796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e144b69b-5287-4f1d-b384-275c7d6fc2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:54Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdd5221-d5e2-4a49-b68c-9e95239106ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:54 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdd5221-d5e2-4a49-b68c-9e95239106ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54cdc3-3424-4559-9516-b9e3bd4a8f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54cdc3-3424-4559-9516-b9e3bd4a8f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e144b69b-5287-4f1d-b384-275c7d6fc2fc', 'volume_name': 'volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8091b8-7b9f-4988-af17-a57f22ceb157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be8091b8-7b9f-4988-af17-a57f22ceb157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd44b3df-056e-477e-a9bf-3bb7a1a9e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:54 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Volume e144b69b-5287-4f1d-b384-275c7d6fc2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc', 'volume_size': 1} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a 1073741824" returned: 0 in 1.348s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:54 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a Jul 06 10:29:54 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:54 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-054c18c7-f710-40e5-8c65-3ccd27d8286c" returned: 0 in 1.147s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-054c18c7-f710-40e5-8c65-3ccd27d8286c" released by "delete_volume" :: held 2.083s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created reservations ['8974f8ad-6ea3-483f-a179-847ed8f5f2fc', 'a7616b6a-c2fa-44bd-bb40-22e758a3daa9', 'b3a382a4-8c2d-4b77-83c0-c146c15826c2', '60f81924-3ac5-48ec-8f91-715479d81f30'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:54 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:54 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:54 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.877s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:54 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Deleted volume successfully. Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6385c0fe-3f42-4ed0-a232-0687065af033 tempest-VolumeAndVolumeTypeFromImageTest-1139159284 None] Lock "cinder-c9f1714e-c598-4e4f-aa82-1bcd80b1b7b5-delete_volume" released by "delete_volume" :: held 4.178s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:54 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a" returned: 0 in 0.707s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.754s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1489257917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:50Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Creating volume 2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:54 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:55 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f 1073741824 Jul 06 10:29:55 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7934f3-25c0-48dd-a788-32cec627fbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39a8276-da6c-46b9-a934-6084ee38d74a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc78d096-a5b6-4d42-9ac7-8236b5d8b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:55 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume volume-d39a8276-da6c-46b9-a934-6084ee38d74a (d39a8276-da6c-46b9-a934-6084ee38d74a): created successfully Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc78d096-a5b6-4d42-9ac7-8236b5d8b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (08d6c22b-0103-4955-889d-7792e3c5e0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-64d69bf4-7efe-4aa7-ae57-98f2c4b27183 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created volume successfully. Jul 06 10:29:55 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.857s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Deleted volume successfully. Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-55d748c8-e205-46dc-8b49-b69bec9f3fbf tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-054c18c7-f710-40e5-8c65-3ccd27d8286c-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-64f4d276-007d-4e35-b96d-77bf63f8137e-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-64f4d276-007d-4e35-b96d-77bf63f8137e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "cinder-quobyte-64f4d276-007d-4e35-b96d-77bf63f8137e" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-64f4d276-007d-4e35-b96d-77bf63f8137e" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e619d045-f8c8-44f9-a453-2d1e4bcbd9ee]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:55 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e Jul 06 10:29:55 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:55 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f 1073741824" returned: 0 in 1.004s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:56 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f Jul 06 10:29:56 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:56 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e" returned: 0 in 0.879s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:56 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e Jul 06 10:29:56 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:56 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f" returned: 0 in 0.849s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.072s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1172781400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ef4440-a395-4111-8490-fdfcc8801936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a897c7a1300a4eb9bb305423c40b27c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:51Z,use_quota=True,user_id='cb4fbec283d14b1689dce3fb262e0568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Creating volume 44ef4440-a395-4111-8490-fdfcc8801936 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:56 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1053edf-83e2-4f07-a1af-669606dd4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:56 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 1073741824 Jul 06 10:29:56 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2aca03-7961-4b4b-a937-3e8320c799ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:57 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f (2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f): created successfully Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2aca03-7961-4b4b-a937-3e8320c799ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (594f9feb-0c3c-40a4-b1e1-6238b31f3bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:57 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2dedeb41-077b-4ed3-b59b-210866ab7151 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created volume successfully. Jul 06 10:29:57 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-64f4d276-007d-4e35-b96d-77bf63f8137e" returned: 0 in 0.824s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-quobyte-64f4d276-007d-4e35-b96d-77bf63f8137e" released by "delete_volume" :: held 1.757s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Created reservations ['815e83a5-b7d1-4168-b372-04ae2a19921b', 'bca61d57-56a0-484c-a9ea-5e1ff87d9650', 'dfce94f3-dd4f-4374-8c00-782b0f114f40', '43a61464-29d8-4124-a2ea-91e65c80ca31'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:57 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:57 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:57 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 1073741824" returned: 0 in 1.017s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:58 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 Jul 06 10:29:58 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:58 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.786s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Deleted volume successfully. Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f12215fd-01e3-4fb8-a812-657e1f7dd359 tempest-CreateVolumesFromSourceVolumeTest-1960990663 None] Lock "cinder-64f4d276-007d-4e35-b96d-77bf63f8137e-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:29:58 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936" returned: 0 in 0.835s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.604s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703110796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e144b69b-5287-4f1d-b384-275c7d6fc2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:29:54Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Creating volume e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:29:58 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:58 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc 1073741824 Jul 06 10:29:58 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfd2df7-048b-4d41-89da-4f9b9f75f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ef4440-a395-4111-8490-fdfcc8801936', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5709ec-70a5-403d-a3b3-363a31ac00dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:29:58 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Volume volume-44ef4440-a395-4111-8490-fdfcc8801936 (44ef4440-a395-4111-8490-fdfcc8801936): created successfully Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c5709ec-70a5-403d-a3b3-363a31ac00dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Flow 'volume_create_manager' (298aa565-f3eb-4e59-8be6-94064a82344a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:29:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9fd8b64a-2488-4f36-b73c-0a4863a6979b tempest-CreateVolumesFromSnapshotTest-352676270 None] Created volume successfully. Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:29:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:29:59 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:29:59 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-44ef4440-a395-4111-8490-fdfcc8801936-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-44ef4440-a395-4111-8490-fdfcc8801936-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:59 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-44ef4440-a395-4111-8490-fdfcc8801936" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.907s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-44ef4440-a395-4111-8490-fdfcc8801936" acquired by "delete_volume" :: waited 0.052s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f847ab94-31b9-4855-afe2-2d9af5ca1892]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:29:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:00 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc 1073741824" returned: 0 in 1.212s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:00 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc Jul 06 10:30:00 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:00 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 Jul 06 10:30:00 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:00 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936" returned: 0 in 0.983s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:01 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936 Jul 06 10:30:01 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:01 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc" returned: 0 in 0.969s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd44b3df-056e-477e-a9bf-3bb7a1a9e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6bf59-b62d-47b9-a2ac-c856dd1f16c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Volume volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc (e144b69b-5287-4f1d-b384-275c7d6fc2fc): created successfully Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d6bf59-b62d-47b9-a2ac-c856dd1f16c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (bb17b373-bd44-4685-9114-eb8617fa0538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d84d8054-de00-45d3-8282-7ad27584f242 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:30:01 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-44ef4440-a395-4111-8490-fdfcc8801936" returned: 0 in 0.852s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-44ef4440-a395-4111-8490-fdfcc8801936" released by "delete_volume" :: held 1.898s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Flow 'volume_create_manager' (fcca09da-c691-4529-939a-74ced7247374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf124da-decd-4533-af82-4231f69aa95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bf124da-decd-4533-af82-4231f69aa95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1057402861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29837a5-eb27-4e37-9ad1-ed5d72de1368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb5d5e619df4fc78b0bc3b9eebb071e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:02Z,use_quota=True,user_id='4dcb6496d8f54391b1305d7aadf00420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d33bf4-84b4-4c6a-b04b-82eb5dc52bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88d33bf4-84b4-4c6a-b04b-82eb5dc52bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c52abd5-af8e-4ec8-b2cd-c0c639201345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c52abd5-af8e-4ec8-b2cd-c0c639201345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29837a5-eb27-4e37-9ad1-ed5d72de1368', 'volume_name': 'volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7a9e6d-feec-4d4a-9214-b0415272950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7a9e6d-feec-4d4a-9214-b0415272950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6991fe13-a6c0-4192-970d-7b9be9044863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Volume b29837a5-eb27-4e37-9ad1-ed5d72de1368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368', 'volume_size': 1} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1057402861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29837a5-eb27-4e37-9ad1-ed5d72de1368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb5d5e619df4fc78b0bc3b9eebb071e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:02Z,use_quota=True,user_id='4dcb6496d8f54391b1305d7aadf00420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Creating volume b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:01 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:30:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:02 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 1073741824 Jul 06 10:30:02 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Created reservations ['8ae905b6-25d9-4e5d-bf64-05f77a5e4cad', '94af0b9f-ce90-40e6-93a9-bc71e93ce4d3', '1bd27804-e927-4ce4-875f-da82dc12f3f4', '06980375-40b8-4a8d-9fac-6f0be8e7302e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:02 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:02 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:02 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.684s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Deleted volume successfully. Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3324c49-6d76-431b-a53a-990c0718bf8c tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-44ef4440-a395-4111-8490-fdfcc8801936-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:02 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 1073741824" returned: 0 in 0.981s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:03 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 Jul 06 10:30:03 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2e3adc-73f6-433c-a215-6c9f4465ba15]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:03 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f Jul 06 10:30:03 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:03 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368" returned: 0 in 0.675s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.567s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Creating offline snapshot 5f037bee-5fe0-4729-aadd-622ef1edc169 of volume e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6991fe13-a6c0-4192-970d-7b9be9044863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0325c6d-429f-4c48-8ddd-0f1f2600d145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[62379f1c-f0d4-4bdc-bf10-6e2bc856d190]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Volume volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 (b29837a5-eb27-4e37-9ad1-ed5d72de1368): created successfully Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0325c6d-429f-4c48-8ddd-0f1f2600d145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Flow 'volume_create_manager' (fcca09da-c691-4529-939a-74ced7247374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7cc3caa6-a23a-4e8d-a450-f20ae64d5893 tempest-VolumeDependencyTests-1915978617 None] Created volume successfully. Jul 06 10:30:03 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc Jul 06 10:30:03 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:04 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f" returned: 0 in 0.951s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:04 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f Jul 06 10:30:04 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:04 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc" returned: 0 in 0.866s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:04 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 1G Jul 06 10:30:04 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:05 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f" returned: 0 in 0.930s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f" released by "delete_volume" :: held 1.927s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created reservations ['a159f24e-d773-4dbf-8284-71cd59739cc6', '53289157-69ad-4ca7-bf04-2e0b43c1720a', 'ceaf7f2c-a05f-448b-a452-4105039a84b2', 'eef1e43d-29fe-49ae-8b63-e289371ea5b0'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:05 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:05 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-d39a8276-da6c-46b9-a934-6084ee38d74a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-d39a8276-da6c-46b9-a934-6084ee38d74a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-d39a8276-da6c-46b9-a934-6084ee38d74a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:05 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-d39a8276-da6c-46b9-a934-6084ee38d74a" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 1G" returned: 0 in 1.085s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3497fc9e-17bf-4f98-bd68-3930a3267193]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:05 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 Jul 06 10:30:05 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:05 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a Jul 06 10:30:05 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:06 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.801s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:06 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Deleted volume successfully. Jul 06 10:30:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-809bdb8b-6bb8-4597-8437-95ab800b0dd3 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-2ea0fc97-96cd-4abe-bbf1-1f72cc346d4f-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:06 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169" returned: 0 in 0.820s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:06 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 is being set with open permissions: ugo+rw Jul 06 10:30:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:06 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 Jul 06 10:30:06 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:06 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a" returned: 0 in 1.017s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:06 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a Jul 06 10:30:06 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:07 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169" returned: 0 in 0.846s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:07 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.info Jul 06 10:30:07 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:07 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d39a8276-da6c-46b9-a934-6084ee38d74a" returned: 0 in 0.788s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-d39a8276-da6c-46b9-a934-6084ee38d74a" released by "delete_volume" :: held 1.878s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created reservations ['6fec002b-9a5e-4908-ad1d-6c9ed39bc343', '26758260-7caf-4360-afed-f415b9934705', '2682bc8e-d506-4339-981f-0db59689c6fd', '4475e850-15e8-4eb3-8a03-b910f9a50392'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:07 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:07 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-1bb3bac7-06c5-42bb-af26-942c0cbe6034-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-1bb3bac7-06c5-42bb-af26-942c0cbe6034-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-1bb3bac7-06c5-42bb-af26-942c0cbe6034" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-1bb3bac7-06c5-42bb-af26-942c0cbe6034" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c3e5aa-1c0f-45fe-b08f-875fd7dd0d4f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:08 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 Jul 06 10:30:08 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:08 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.info" returned: 0 in 0.896s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:08 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.info is being set with open permissions: ugo+rw Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:08 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.info Jul 06 10:30:08 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:08 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.945s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Deleted volume successfully. Jul 06 10:30:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3f33f2f-537a-4ed1-8b2b-1dc9e4e57030 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-d39a8276-da6c-46b9-a934-6084ee38d74a-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:09 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034" returned: 0 in 0.947s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:09 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034 Jul 06 10:30:09 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:09 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.info" returned: 0 in 0.882s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.506s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.972s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Creating offline snapshot b41114dd-402d-4109-a2c7-a6079bcddae2 of volume b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de4819f-4240-4c9f-b8f9-f385cc2a1cd5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:09 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-578bb8ca-708b-48aa-9938-936fbe872c5d tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:30:09 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 Jul 06 10:30:09 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-5f037bee-5fe0-4729-aadd-622ef1edc169-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Lock "cinder-5f037bee-5fe0-4729-aadd-622ef1edc169-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-e144b69b-5287-4f1d-b384-275c7d6fc2fc" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-e144b69b-5287-4f1d-b384-275c7d6fc2fc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-5f037bee-5fe0-4729-aadd-622ef1edc169" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-5f037bee-5fe0-4729-aadd-622ef1edc169" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot 5f037bee-5fe0-4729-aadd-622ef1edc169 of volume e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e877cd46-bf3d-41ac-bf3e-bd7f4205c30e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:09 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-1bb3bac7-06c5-42bb-af26-942c0cbe6034" returned: 0 in 0.747s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-1bb3bac7-06c5-42bb-af26-942c0cbe6034" released by "delete_volume" :: held 1.750s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:09 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 Jul 06 10:30:09 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:09 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Created reservations ['d65c769a-c317-4c44-aece-c02ba9cee3fa', 'e553e3a2-1a18-4f07-88a9-0aba69535bc5', '3fbdb2d4-19fd-4eee-93ee-decc4ba11a21', 'faaa0da6-c6d9-4fee-a716-acfa1ed2e4b0'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:10 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:10 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-bff47e12-bafb-4af1-9ff2-d5941ba770de-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:10 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368" returned: 0 in 1.050s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-bff47e12-bafb-4af1-9ff2-d5941ba770de-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:10 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 1G Jul 06 10:30:10 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-bff47e12-bafb-4af1-9ff2-d5941ba770de" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-bff47e12-bafb-4af1-9ff2-d5941ba770de" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ec6a56-15bc-4639-a574-ce1fbc4ed142]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:10 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de Jul 06 10:30:10 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:10 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169" returned: 0 in 1.130s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33660e6-1e84-4673-af0b-0ba9d9f0e9bf]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:10 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.921s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Deleted volume successfully. Jul 06 10:30:10 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ed1f41e2-82ed-416b-89a9-2214dc70dc7d tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-1bb3bac7-06c5-42bb-af26-942c0cbe6034-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:11 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc Jul 06 10:30:11 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:11 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 1G" returned: 0 in 1.121s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:11 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 Jul 06 10:30:11 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:11 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de" returned: 0 in 1.104s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:11 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de Jul 06 10:30:11 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:11 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc" returned: 0 in 1.138s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:11 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 Jul 06 10:30:11 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:12 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-bff47e12-bafb-4af1-9ff2-d5941ba770de" returned: 0 in 0.811s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-bff47e12-bafb-4af1-9ff2-d5941ba770de" released by "delete_volume" :: held 1.992s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:12 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2" returned: 0 in 1.005s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:12 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 is being set with open permissions: ugo+rw Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:12 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 Jul 06 10:30:12 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created reservations ['1bdc25f8-9009-4545-8401-9a2b89148aec', '394ebf26-cf5a-47c4-86bc-50bb231fd554', 'c67e2fd9-35c0-4857-a1a2-f321b5d6c95e', 'de1321f0-b66d-4bea-b4a9-6e5472477eed'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-1662895e-4bb4-408d-9496-716fddf9d7a0-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:12 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:12 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-1662895e-4bb4-408d-9496-716fddf9d7a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-5b6b2776-4484-45d4-8176-c2e23db30b86" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-5b6b2776-4484-45d4-8176-c2e23db30b86" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-1662895e-4bb4-408d-9496-716fddf9d7a0" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-1662895e-4bb4-408d-9496-716fddf9d7a0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Deleting offline snapshot 1662895e-4bb4-408d-9496-716fddf9d7a0 of volume 5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] snapshot_file for this snap is: volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d34d2cc-add1-4e1f-a170-f0dabd13b409]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:12 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 Jul 06 10:30:12 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:12 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169" returned: 0 in 1.011s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:13 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169 Jul 06 10:30:13 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:13 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2" returned: 0 in 0.951s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:13 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.info Jul 06 10:30:13 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:13 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.935s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Deleted volume successfully. Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0485bd8b-8ca5-4f8b-9618-4dfc33460634 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-bff47e12-bafb-4af1-9ff2-d5941ba770de-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:13 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0" returned: 0 in 1.125s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b6b2776-4484-45d4-8176-c2e23db30b86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:30:13 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc.5f037bee-5fe0-4729-aadd-622ef1edc169" returned: 0 in 0.970s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df400c9-a49d-4a17-a90b-2617cad80d90]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-5f037bee-5fe0-4729-aadd-622ef1edc169" released by "_delete_snapshot" :: held 4.426s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-e144b69b-5287-4f1d-b384-275c7d6fc2fc" released by "delete_snapshot" :: held 4.464s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:14 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 Jul 06 10:30:14 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Created reservations ['29dd003f-9d74-41a3-b688-4d1b501cdbf3', '047d499e-385e-4b04-a5b8-7c8b477e820b', '432454ad-9bcb-41a7-b9b5-eb274e61802b', '91009a06-43c1-428b-8e88-3ebbd7d59bf2'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:14 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cd2575c6-817d-4b62-a782-97fd51d2df16 tempest-ProjectMemberTests-97035211 None] Lock "cinder-5f037bee-5fe0-4729-aadd-622ef1edc169-delete_snapshot" released by "delete_snapshot" :: held 4.706s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:14 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.info" returned: 0 in 1.096s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:14 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.info is being set with open permissions: ugo+rw Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:14 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.info Jul 06 10:30:14 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:14 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86" returned: 0 in 0.916s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:14 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 Jul 06 10:30:14 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-e144b69b-5287-4f1d-b384-275c7d6fc2fc-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Lock "cinder-e144b69b-5287-4f1d-b384-275c7d6fc2fc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-e144b69b-5287-4f1d-b384-275c7d6fc2fc" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-e144b69b-5287-4f1d-b384-275c7d6fc2fc" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[601fbfbe-fa2b-45cc-a117-9919b6213875]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:15 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc Jul 06 10:30:15 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:15 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.info" returned: 0 in 0.892s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.252s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3d86340a-5172-4ab0-b583-17216377885f tempest-VolumeDependencyTests-1915978617 None] Create snapshot completed successfully Jul 06 10:30:15 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0" returned: 0 in 0.815s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:15 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0 Jul 06 10:30:15 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:16 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc" returned: 0 in 0.908s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:16 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc Jul 06 10:30:16 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:16 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86.1662895e-4bb4-408d-9496-716fddf9d7a0" returned: 0 in 0.914s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Flow 'volume_create_manager' (a2c855e7-080e-4584-b37c-a0cdaecb1198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12150e42-9fb3-414e-b229-7b10dd39140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-1662895e-4bb4-408d-9496-716fddf9d7a0" released by "_delete_snapshot" :: held 3.945s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12150e42-9fb3-414e-b229-7b10dd39140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1045003972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b234cbb-316e-47d7-a528-1d9d3d071121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eb5d5e619df4fc78b0bc3b9eebb071e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b41114dd-402d-4109-a2c7-a6079bcddae2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:17Z,use_quota=True,user_id='4dcb6496d8f54391b1305d7aadf00420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8eb72a-1359-4b7f-82f7-7cb82d8f383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8eb72a-1359-4b7f-82f7-7cb82d8f383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266e5649-9168-4acf-b487-8216078adc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266e5649-9168-4acf-b487-8216078adc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b234cbb-316e-47d7-a528-1d9d3d071121', 'volume_name': 'volume-8b234cbb-316e-47d7-a528-1d9d3d071121', 'volume_size': 1, 'snapshot_id': 'b41114dd-402d-4109-a2c7-a6079bcddae2'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c136d47e-ef21-4fc4-a54a-097fabf83dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c136d47e-ef21-4fc4-a54a-097fabf83dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c249a171-19bc-4746-971c-001c1d43091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:16 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Volume 8b234cbb-316e-47d7-a528-1d9d3d071121: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b234cbb-316e-47d7-a528-1d9d3d071121', 'volume_size': 1, 'snapshot_id': 'b41114dd-402d-4109-a2c7-a6079bcddae2'} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-5b6b2776-4484-45d4-8176-c2e23db30b86" released by "delete_snapshot" :: held 4.020s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=158,cinder:INSERT=50,cinder:UPDATE=199,cinder:DELETE=25 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-quobyte-b41114dd-402d-4109-a2c7-a6079bcddae2-8b234cbb-316e-47d7-a528-1d9d3d071121" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b41114dd-402d-4109-a2c7-a6079bcddae2-8b234cbb-316e-47d7-a528-1d9d3d071121" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Creating volume 8b234cbb-316e-47d7-a528-1d9d3d071121 from snapshot b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-quobyte-8b234cbb-316e-47d7-a528-1d9d3d071121" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:16 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-e144b69b-5287-4f1d-b384-275c7d6fc2fc" returned: 0 in 0.720s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-8b234cbb-316e-47d7-a528-1d9d3d071121" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] snapshot: b41114dd-402d-4109-a2c7-a6079bcddae2, volume: 8b234cbb-316e-47d7-a528-1d9d3d071121, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-e144b69b-5287-4f1d-b384-275c7d6fc2fc" released by "delete_volume" :: held 1.710s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce6614-e74b-4d31-9ff2-25f0e868fd0e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:16 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created reservations ['bc15ced1-7bd5-4f20-aa65-728b00f595d5', '01d7ad47-38e5-4ee0-8353-293218d1004f', 'fbf0d5d0-02ee-436f-bf69-ab8e58d52506', '34ee2af6-35ef-42df-87e3-390da7358780'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Created reservations ['fae9c46b-4119-47aa-8e99-459ff1f52e31', 'cbfa83a2-b335-489e-8ecc-a69acb472a6f', '2604e7b3-f974-42a4-995b-aaf32329c83e', '4988fe8a-b42e-4c7e-9b51-caa79c003b1d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Delete snapshot completed successfully. Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c70beeff-e4d0-4745-8bbe-0964bdacbe96 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-1662895e-4bb4-408d-9496-716fddf9d7a0-delete_snapshot" released by "delete_snapshot" :: held 4.373s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:17 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 Jul 06 10:30:17 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:17 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:17 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=235,cinder:SELECT=153,cinder:INSERT=59,cinder:DELETE=15 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (df4b3cfc-c21f-4179-a458-a2696edffff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:17 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed872a2-ba02-4c11-afc9-437b7a539807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed872a2-ba02-4c11-afc9-437b7a539807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2086392498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c94d00-b2ff-46e3-b231-9d3d2c66f95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:18Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a267818e-4e74-40ee-8012-9ffb1642b1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a267818e-4e74-40ee-8012-9ffb1642b1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65f4fd7-47a2-43a1-b8d8-d17c26fd3959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65f4fd7-47a2-43a1-b8d8-d17c26fd3959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c94d00-b2ff-46e3-b231-9d3d2c66f95a', 'volume_name': 'volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0930b2d7-c79a-4669-8667-b86b450b2a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0930b2d7-c79a-4669-8667-b86b450b2a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a795410-c7aa-4bf6-a2cf-b3d3831be420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:18 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:18 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Volume a9c94d00-b2ff-46e3-b231-9d3d2c66f95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a', 'volume_size': 1} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-5b6b2776-4484-45d4-8176-c2e23db30b86-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2" returned: 0 in 1.140s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:30:18 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.987s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-5b6b2776-4484-45d4-8176-c2e23db30b86-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eccd963-7d67-4ff1-957b-c618c6315bde]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2cca4502-71d6-412e-ab20-8a6ed89a770a tempest-ProjectMemberTests-97035211 None] Lock "cinder-e144b69b-5287-4f1d-b384-275c7d6fc2fc-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "cinder-quobyte-5b6b2776-4484-45d4-8176-c2e23db30b86" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-5b6b2776-4484-45d4-8176-c2e23db30b86" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:18 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 Jul 06 10:30:18 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0403cd-e34c-48c3-a239-dde6deffc888]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:18 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 Jul 06 10:30:18 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:19 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368" returned: 0 in 1.232s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:19 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:30:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:19 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 Jul 06 10:30:19 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:19 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86" returned: 0 in 1.130s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:19 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86 Jul 06 10:30:19 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:20 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5b6b2776-4484-45d4-8176-c2e23db30b86" returned: 0 in 0.726s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-quobyte-5b6b2776-4484-45d4-8176-c2e23db30b86" released by "delete_volume" :: held 1.942s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Created reservations ['9ac75e20-8fb9-41d4-a26d-38be226cd378', 'c8aea8f6-eb94-44f8-9f42-cb4103734fa3', 'c21ff20c-9523-4dbc-9b80-263dd2306812', '09400122-8fa7-4100-a35d-4b389db70663'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:20 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:20 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:21 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.472s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:21 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Deleted volume successfully. Jul 06 10:30:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a65113e1-4589-4989-8ec0-0bc0308c3038 tempest-CreateVolumesFromSnapshotTest-352676270 None] Lock "cinder-5b6b2776-4484-45d4-8176-c2e23db30b86-delete_volume" released by "delete_volume" :: held 3.893s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:25 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121" returned: 0 in 6.498s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f8d44-b414-4ae8-bb21-eaa66d4caa3c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:25 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 Jul 06 10:30:25 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:26 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368" returned: 0 in 1.029s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:26 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:30:26 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Converted 1024.00 MB image at 157.56 MB/s Jul 06 10:30:26 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 is being set with open permissions: ugo+rw Jul 06 10:30:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:26 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 Jul 06 10:30:26 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:27 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121" returned: 0 in 0.680s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-8b234cbb-316e-47d7-a528-1d9d3d071121" released by "_copy_volume_from_snapshot" :: held 10.779s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b41114dd-402d-4109-a2c7-a6079bcddae2-8b234cbb-316e-47d7-a528-1d9d3d071121" released by "_create_volume_from_snapshot" :: held 10.830s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.854s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.551s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2086392498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c94d00-b2ff-46e3-b231-9d3d2c66f95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:18Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Creating volume a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:27 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:27 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a 1073741824 Jul 06 10:30:27 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c249a171-19bc-4746-971c-001c1d43091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b234cbb-316e-47d7-a528-1d9d3d071121', 'volume_size': 1, 'snapshot_id': 'b41114dd-402d-4109-a2c7-a6079bcddae2'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631c5204-9e02-4c03-a4de-02c220ea5df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:27 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Volume volume-8b234cbb-316e-47d7-a528-1d9d3d071121 (8b234cbb-316e-47d7-a528-1d9d3d071121): created successfully Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631c5204-9e02-4c03-a4de-02c220ea5df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Flow 'volume_create_manager' (a2c855e7-080e-4584-b37c-a0cdaecb1198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:27 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-895e2ac5-4d45-4ce8-9e48-0b588e28c936 tempest-VolumeDependencyTests-1915978617 None] Created volume successfully. Jul 06 10:30:28 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a 1073741824" returned: 0 in 0.990s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:28 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a Jul 06 10:30:28 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-b41114dd-402d-4109-a2c7-a6079bcddae2-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-b41114dd-402d-4109-a2c7-a6079bcddae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-quobyte-b29837a5-eb27-4e37-9ad1-ed5d72de1368" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b29837a5-eb27-4e37-9ad1-ed5d72de1368" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-quobyte-b41114dd-402d-4109-a2c7-a6079bcddae2" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b41114dd-402d-4109-a2c7-a6079bcddae2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Deleting offline snapshot b41114dd-402d-4109-a2c7-a6079bcddae2 of volume b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] snapshot_file for this snap is: volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b483d332-d900-422f-ab8e-99cda8310169]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:29 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 Jul 06 10:30:29 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:29 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" returned: 0 in 0.921s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a795410-c7aa-4bf6-a2cf-b3d3831be420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff1e455-484a-45b2-b028-7f12e27709bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Volume volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a (a9c94d00-b2ff-46e3-b231-9d3d2c66f95a): created successfully Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff1e455-484a-45b2-b028-7f12e27709bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (df4b3cfc-c21f-4179-a458-a2696edffff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f80d637a-fb0c-4e12-a1e3-f1b137d0ae72 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:30:29 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2" returned: 0 in 1.110s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9990826e-d2de-4e28-804f-758767fddf45]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:30 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 Jul 06 10:30:30 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Flow 'volume_create_manager' (d36defd8-9a6a-4b4e-ab47-1cd1c782073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5dc8c1-d8c2-4a4d-be21-bb821798df7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5dc8c1-d8c2-4a4d-be21-bb821798df7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9edd2248fcc436bb3aeb9883f3c27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:30Z,use_quota=True,user_id='202b4ea740474feeb3fe877f52077bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db81358-68db-4ad2-a50f-734e62b6cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db81358-68db-4ad2-a50f-734e62b6cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faa6fde-7df5-4dd3-a09e-b13a0d5b02c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.image.glance [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Creating Keystone auth plugin from conf {{(pid=86456) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Flow 'volume_create_manager' (37a355c9-51a9-45ac-a012-61ce483a4358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c00deff-037e-45a1-a72a-b7404a06afa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Creating offline snapshot 95852ef5-e987-4b70-b8b8-f3291b9a6c52 of volume a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c00deff-037e-45a1-a72a-b7404a06afa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2024878728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e92a5e-28f5-4572-ade1-b901b41d6fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9090afd85b1a48268336f9faa2f2967a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:31Z,use_quota=True,user_id='804322d32124465d9391587e2df40673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f01fbe-24b1-45b7-88a3-a960adcb2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f01fbe-24b1-45b7-88a3-a960adcb2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae09bc41-fdbb-40b9-8531-eddfe691de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae09bc41-fdbb-40b9-8531-eddfe691de04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e92a5e-28f5-4572-ade1-b901b41d6fe4', 'volume_name': 'volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe3aef1-d079-4331-a2bb-387500d607c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe3aef1-d079-4331-a2bb-387500d607c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffdb36f-23e3-4e14-ae90-f1646be2a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Volume 21e92a5e-28f5-4572-ade1-b901b41d6fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4', 'volume_size': 1} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9108ef-9b65-4ce0-a75e-44e32a29b903]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5faa6fde-7df5-4dd3-a09e-b13a0d5b02c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9', 'volume_name': 'volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9', 'volume_size': 1, 'image_id': '7c152e43-1898-4fb5-a93a-23457b3c4d16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c152e43-1898-4fb5-a93a-23457b3c4d16', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6116ee1ea0a169c8e133e72ee1a2913', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9edd2248fcc436bb3aeb9883f3c27e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b21eb0ac128d4fae69df9b6c10423908fbce808f338425d911c177fca0c3e5ecfaa98cae52aaa9aa7f4fd3f6750853318795ce842c6ab8187baf1a62cd9e7c82', 'id': '7c152e43-1898-4fb5-a93a-23457b3c4d16', 'created_at': datetime.datetime(2026, 7, 6, 8, 30, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 30, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c152e43-1898-4fb5-a93a-23457b3c4d16/file', 'properties': {}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d86ea3b-1d56-4dc2-bf05-dafb885fa4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d86ea3b-1d56-4dc2-bf05-dafb885fa4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccbd8e9-c6fb-4cac-8de5-60b5127d5478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:30 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Volume de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9', 'volume_size': 1, 'image_id': '7c152e43-1898-4fb5-a93a-23457b3c4d16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c152e43-1898-4fb5-a93a-23457b3c4d16', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6116ee1ea0a169c8e133e72ee1a2913', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9edd2248fcc436bb3aeb9883f3c27e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b21eb0ac128d4fae69df9b6c10423908fbce808f338425d911c177fca0c3e5ecfaa98cae52aaa9aa7f4fd3f6750853318795ce842c6ab8187baf1a62cd9e7c82', 'id': '7c152e43-1898-4fb5-a93a-23457b3c4d16', 'created_at': datetime.datetime(2026, 7, 6, 8, 30, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 30, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c152e43-1898-4fb5-a93a-23457b3c4d16/file', 'properties': {}}, 'image_service': } Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Trying to clone de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 from image 7c152e43-1898-4fb5-a93a-23457b3c4d16 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c152e43-1898-4fb5-a93a-23457b3c4d16', 'metadata': {}}]). {{(pid=86456) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 10:30:30 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a Jul 06 10:30:30 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:30 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368" returned: 0 in 0.950s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:30 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 Jul 06 10:30:30 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:30 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 10:30:30 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Image download 0.00 MB at 0.00 MB/s Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[60801e69-a933-4c0b-9f2d-7a60f622ab1f]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:31 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD Jul 06 10:30:31 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:31 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" returned: 0 in 0.824s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:31 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 1G Jul 06 10:30:31 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:31 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2" returned: 0 in 0.815s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:31 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2 Jul 06 10:30:31 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:31 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:31 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD Jul 06 10:30:31 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:32 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368.b41114dd-402d-4109-a2c7-a6079bcddae2" returned: 0 in 0.660s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:32 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 1G" returned: 0 in 0.812s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:32 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 Jul 06 10:30:32 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b41114dd-402d-4109-a2c7-a6079bcddae2" released by "_delete_snapshot" :: held 3.682s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b29837a5-eb27-4e37-9ad1-ed5d72de1368" released by "delete_snapshot" :: held 3.711s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:32 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD" returned: 1 in 0.721s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Temporary image 7c152e43-1898-4fb5-a93a-23457b3c4d16 is fetched for user 202b4ea740474feeb3fe877f52077bd1. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Created reservations ['026dcb35-c577-495d-b5df-98ef1d87e1a1', 'b5fc0639-cacb-4b26-b59c-4336ed769946', '66978cd2-99eb-41c3-b9fa-e4eb72186eee', '2dd30a40-5dad-4ae1-a570-151f8e31e379'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5df3bb-21b5-41ad-9329-c1389b4bdf21]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Delete snapshot completed successfully. Jul 06 10:30:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-94a7b435-0d8d-4a23-95ec-b4f73c6bdb73 tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-b41114dd-402d-4109-a2c7-a6079bcddae2-delete_snapshot" released by "delete_snapshot" :: held 3.921s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:32 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD Jul 06 10:30:32 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:33 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52" returned: 0 in 0.709s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:33 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 is being set with open permissions: ugo+rw Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:33 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 Jul 06 10:30:33 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:33 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-b29837a5-eb27-4e37-9ad1-ed5d72de1368-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-b29837a5-eb27-4e37-9ad1-ed5d72de1368-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-quobyte-b29837a5-eb27-4e37-9ad1-ed5d72de1368" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:33 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD Jul 06 10:30:33 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b29837a5-eb27-4e37-9ad1-ed5d72de1368" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2fd61d-71bd-4874-9c10-97be047749ff]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:33 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 Jul 06 10:30:33 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:33 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52" returned: 0 in 0.706s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:33 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.info Jul 06 10:30:33 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:34 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD" returned: 1 in 0.735s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:34 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368" returned: 0 in 0.756s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:34 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368 Jul 06 10:30:34 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:34 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.info" returned: 0 in 0.661s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:34 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.info is being set with open permissions: ugo+rw Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:34 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.info Jul 06 10:30:34 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:34 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-b29837a5-eb27-4e37-9ad1-ed5d72de1368" returned: 0 in 0.719s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-b29837a5-eb27-4e37-9ad1-ed5d72de1368" released by "delete_volume" :: held 1.542s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Created reservations ['c6177b0f-09bd-4499-96d7-35c9f2de3c6f', '3bfb5dff-670f-410f-9446-2c402083e012', 'c5744fdd-df1e-4633-9b3b-dc53896c3db8', '395c3b4a-829e-4bec-b3c0-380d32b06b96'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:35 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:35 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:35 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.info" returned: 0 in 0.671s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.543s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.445s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2024878728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e92a5e-28f5-4572-ade1-b901b41d6fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9090afd85b1a48268336f9faa2f2967a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:31Z,use_quota=True,user_id='804322d32124465d9391587e2df40673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Creating volume 21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:35 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:35 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 1073741824 Jul 06 10:30:35 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-43fc0177-1aec-4a82-99ef-89b1245fcc1e tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-8b234cbb-316e-47d7-a528-1d9d3d071121-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-8b234cbb-316e-47d7-a528-1d9d3d071121-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "cinder-quobyte-8b234cbb-316e-47d7-a528-1d9d3d071121" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-8b234cbb-316e-47d7-a528-1d9d3d071121" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a8ebc-2ef6-4e90-ac6e-00013e9c20d3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-95852ef5-e987-4b70-b8b8-f3291b9a6c52-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:35 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.712s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:35 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Deleted volume successfully. Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Lock "cinder-95852ef5-e987-4b70-b8b8-f3291b9a6c52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-95852ef5-e987-4b70-b8b8-f3291b9a6c52" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-827c58f7-0bd8-4bb8-817d-eb41c018cdaf tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-b29837a5-eb27-4e37-9ad1-ed5d72de1368-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-95852ef5-e987-4b70-b8b8-f3291b9a6c52" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot 95852ef5-e987-4b70-b8b8-f3291b9a6c52 of volume a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a9f1db-cd72-4674-bd5a-fa18e216c117]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:35 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 Jul 06 10:30:35 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:36 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 Jul 06 10:30:36 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:36 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 1073741824" returned: 0 in 0.923s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:36 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 Jul 06 10:30:36 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:36 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121" returned: 0 in 0.793s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:36 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121 Jul 06 10:30:36 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:36 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52" returned: 0 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e6a835-fc50-4b68-a6cf-613a4076fb4f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:36 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4" returned: 0 in 0.662s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.791s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9edd2248fcc436bb3aeb9883f3c27e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:30Z,use_quota=True,user_id='202b4ea740474feeb3fe877f52077bd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Creating volume de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:36 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:36 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 1073741824 Jul 06 10:30:36 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffdb36f-23e3-4e14-ae90-f1646be2a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6a6855-70ee-44b5-95c8-f1a534198db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:36 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Volume volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 (21e92a5e-28f5-4572-ade1-b901b41d6fe4): created successfully Jul 06 10:30:36 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a Jul 06 10:30:36 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6a6855-70ee-44b5-95c8-f1a534198db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:36 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Flow 'volume_create_manager' (37a355c9-51a9-45ac-a012-61ce483a4358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-65505357-40cd-4b8e-8f05-f321e49b85ce tempest-SnapshotDependencyTests-1095943949 None] Created volume successfully. Jul 06 10:30:37 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-8b234cbb-316e-47d7-a528-1d9d3d071121" returned: 0 in 0.661s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-quobyte-8b234cbb-316e-47d7-a528-1d9d3d071121" released by "delete_volume" :: held 1.528s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Created reservations ['8593a072-c93a-4b72-a25f-dc8f9f0b8689', '6a0e63ce-dc42-45b5-9660-81b3ce930683', 'e549dc10-2ede-4be5-aaf6-44009eb505dd', '4bc63025-cca8-4745-af04-eb280b9aaa2f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:37 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:37 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:37 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" returned: 0 in 0.832s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:37 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 Jul 06 10:30:37 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:37 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 1073741824" returned: 0 in 0.867s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:37 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 Jul 06 10:30:37 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:38 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.674s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:38 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Deleted volume successfully. Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-c7a44abe-0ab8-4322-ba01-763bf6d5f13a tempest-VolumeDependencyTests-1915978617 None] Lock "cinder-8b234cbb-316e-47d7-a528-1d9d3d071121-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:38 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" returned: 0 in 0.762s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.196s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Creating offline snapshot 672d1145-b20c-42f0-9f65-8bb9b985bb63 of volume 21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Attempting download of 7c152e43-1898-4fb5-a93a-23457b3c4d16 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c152e43-1898-4fb5-a93a-23457b3c4d16', 'metadata': {}}])) to volume de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1346cf20-2910-4c3a-aa4d-c08602a6f8b3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:38 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52" returned: 0 in 0.969s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:38 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52 Jul 06 10:30:38 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2992f4a6-8ae6-4d36-9b23-31a90f9469c3]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c152e43-1898-4fb5-a93a-23457b3c4d16_rpbinblu {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:38 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 Jul 06 10:30:38 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:38 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c152e43-1898-4fb5-a93a-23457b3c4d16_rpbinblu Jul 06 10:30:38 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:39 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a.95852ef5-e987-4b70-b8b8-f3291b9a6c52" returned: 0 in 0.776s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-95852ef5-e987-4b70-b8b8-f3291b9a6c52" released by "_delete_snapshot" :: held 3.553s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" released by "delete_snapshot" :: held 3.585s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Created reservations ['c95316a3-1721-4ddd-abac-b50b270eea78', '8c12a1fd-175e-4e1b-9dc2-986d7ef44b98', '6a274b7d-f76a-4e22-894e-bd045cbce8b5', '1e04b866-b6d7-42b9-a1f3-098191d3a079'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f3230042-7c49-4c0e-8432-975a84a3515c tempest-ProjectMemberTests-97035211 None] Lock "cinder-95852ef5-e987-4b70-b8b8-f3291b9a6c52-delete_snapshot" released by "delete_snapshot" :: held 3.777s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:39 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4" returned: 0 in 1.041s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:39 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 1G Jul 06 10:30:39 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:39 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c152e43-1898-4fb5-a93a-23457b3c4d16_rpbinblu" returned: 0 in 1.034s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c152e43-1898-4fb5-a93a-23457b3c4d16_rpbinblu {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:39 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c152e43-1898-4fb5-a93a-23457b3c4d16_rpbinblu Jul 06 10:30:39 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Lock "cinder-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd6ef7-cbc8-47a3-a6e6-ad949375f68a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:40 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a Jul 06 10:30:40 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:40 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c152e43-1898-4fb5-a93a-23457b3c4d16_rpbinblu" returned: 1 in 0.932s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c152e43-1898-4fb5-a93a-23457b3c4d16_rpbinblu' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:30:40 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a28831-6862-4e7f-87de-e9bf2ee22667]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 1G" returned: 0 in 0.991s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:40 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 Jul 06 10:30:40 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:40 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD Jul 06 10:30:40 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:41 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" returned: 0 in 0.888s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:41 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a Jul 06 10:30:41 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:41 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:41 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63" returned: 0 in 0.846s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:41 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 is being set with open permissions: ugo+rw Jul 06 10:30:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:41 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 Jul 06 10:30:41 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:41 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD Jul 06 10:30:41 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:42 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a" released by "delete_volume" :: held 1.795s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Created reservations ['89773207-1e75-4c4d-b88d-4091739344bd', 'f9de0f69-c221-4a48-acf0-70ce24b22d28', '93f23268-faf4-487d-b3ef-c5c6d14653ca', 'dabe672d-7ca2-4fa4-8f99-6d5108cd962d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:42 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD" returned: 1 in 0.795s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] 7c152e43-1898-4fb5-a93a-23457b3c4d16 was raw, converting to raw {{(pid=86456) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:42 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63" returned: 0 in 0.758s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:42 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 Jul 06 10:30:42 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:42 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:42 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:42 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.info Jul 06 10:30:42 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:42 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.708s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:42 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:43 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-4c8c1ef8-67bf-4396-a2f0-a9b523edd146 tempest-ProjectMemberTests-97035211 None] Lock "cinder-a9c94d00-b2ff-46e3-b231-9d3d2c66f95a-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (1b68f6aa-1069-4c94-b9de-d6ef166476b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9707fa9e-298f-4ab4-9367-dcd8bf613ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9707fa9e-298f-4ab4-9367-dcd8bf613ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875844711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0254f4cc-1528-40ae-8d97-ff3cb898912f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:43Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd4e76d-37ba-4526-855d-5d2519779a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd4e76d-37ba-4526-855d-5d2519779a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55198291-3cd8-4dff-ab51-9cb18e1d7245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55198291-3cd8-4dff-ab51-9cb18e1d7245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0254f4cc-1528-40ae-8d97-ff3cb898912f', 'volume_name': 'volume-0254f4cc-1528-40ae-8d97-ff3cb898912f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:43 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927b4bed-b1d3-4a8f-8730-20330c2fe5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927b4bed-b1d3-4a8f-8730-20330c2fe5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a1f781-8405-4c31-bdcc-8f803feb8806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:43 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Volume 0254f4cc-1528-40ae-8d97-ff3cb898912f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0254f4cc-1528-40ae-8d97-ff3cb898912f', 'volume_size': 1} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.info" returned: 0 in 0.910s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:43 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.info is being set with open permissions: ugo+rw Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:43 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.info Jul 06 10:30:43 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:43 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" returned: 0 in 1.054s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c152e43-1898-4fb5-a93a-23457b3c4d16_ctgtsehrdevstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:30:43 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:43 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 1G Jul 06 10:30:43 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:43 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.info" returned: 0 in 0.695s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.381s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.722s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875844711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0254f4cc-1528-40ae-8d97-ff3cb898912f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:43Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Creating volume 0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:43 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:43 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:43 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f 1073741824 Jul 06 10:30:43 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 1G" returned: 0 in 0.724s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:43 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e7e3dcee-12ce-4321-ad8c-348be6a7ca98 tempest-SnapshotDependencyTests-1095943949 None] Create snapshot completed successfully Jul 06 10:30:44 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[54901357-0d6c-4167-b933-e9a7bd345fa7]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:44 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 Jul 06 10:30:44 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:44 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" returned: 0 in 0.925s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:45 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f 1073741824" returned: 0 in 1.099s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:45 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 Jul 06 10:30:45 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:45 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f Jul 06 10:30:45 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Flow 'volume_create_manager' (f0dab8ff-6c6c-4594-8880-d0e3fbbf2e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3dac61-7fc6-400d-9891-8bb588f17378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3dac61-7fc6-400d-9891-8bb588f17378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891e3029-3563-40ec-8f6e-864c4c0b10ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9090afd85b1a48268336f9faa2f2967a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=672d1145-b20c-42f0-9f65-8bb9b985bb63,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:46Z,use_quota=True,user_id='804322d32124465d9391587e2df40673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117a7d30-54a4-4b0f-9e8a-bd83df4a82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117a7d30-54a4-4b0f-9e8a-bd83df4a82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31eaa7f5-83e1-4122-ac0f-dc9ceea0c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31eaa7f5-83e1-4122-ac0f-dc9ceea0c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '891e3029-3563-40ec-8f6e-864c4c0b10ac', 'volume_name': 'volume-891e3029-3563-40ec-8f6e-864c4c0b10ac', 'volume_size': 1, 'snapshot_id': '672d1145-b20c-42f0-9f65-8bb9b985bb63'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b568e6-b2c2-4c47-ba3c-8aab73c804c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b568e6-b2c2-4c47-ba3c-8aab73c804c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db70116e-ddc6-48ce-a44b-a08f152ef153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:45 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Volume 891e3029-3563-40ec-8f6e-864c4c0b10ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-891e3029-3563-40ec-8f6e-864c4c0b10ac', 'volume_size': 1, 'snapshot_id': '672d1145-b20c-42f0-9f65-8bb9b985bb63'} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:45 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f" returned: 0 in 0.781s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.102s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-quobyte-672d1145-b20c-42f0-9f65-8bb9b985bb63-891e3029-3563-40ec-8f6e-864c4c0b10ac" by "_create_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a1f781-8405-4c31-bdcc-8f803feb8806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0254f4cc-1528-40ae-8d97-ff3cb898912f', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cbe2c5-6bb6-42a5-821b-9f296af9f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:45 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-672d1145-b20c-42f0-9f65-8bb9b985bb63-891e3029-3563-40ec-8f6e-864c4c0b10ac" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Creating volume 891e3029-3563-40ec-8f6e-864c4c0b10ac from snapshot 672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-quobyte-891e3029-3563-40ec-8f6e-864c4c0b10ac" by "_copy_volume_from_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" returned: 1 in 0.989s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Downloaded image 7c152e43-1898-4fb5-a93a-23457b3c4d16 ((None, [{'url': 'file:///opt/stack/data/glance/images/7c152e43-1898-4fb5-a93a-23457b3c4d16', 'metadata': {}}])) to volume de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 successfully. {{(pid=86456) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Temporary image 7c152e43-1898-4fb5-a93a-23457b3c4d16 for user 202b4ea740474feeb3fe877f52077bd1 is deleted. {{(pid=86456) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.volume_utils [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Marking volume de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 as bootable. {{(pid=86456) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 10:30:45 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Volume volume-0254f4cc-1528-40ae-8d97-ff3cb898912f (0254f4cc-1528-40ae-8d97-ff3cb898912f): created successfully Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cbe2c5-6bb6-42a5-821b-9f296af9f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (1b68f6aa-1069-4c94-b9de-d6ef166476b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-891e3029-3563-40ec-8f6e-864c4c0b10ac" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] snapshot: 672d1145-b20c-42f0-9f65-8bb9b985bb63, volume: 891e3029-3563-40ec-8f6e-864c4c0b10ac, {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Copying metadata from image 7c152e43-1898-4fb5-a93a-23457b3c4d16 to de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9. {{(pid=86456) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 10:30:45 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Creating volume glance metadata for volume de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 backed by image 7c152e43-1898-4fb5-a93a-23457b3c4d16 with: {'image_id': '7c152e43-1898-4fb5-a93a-23457b3c4d16', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd6116ee1ea0a169c8e133e72ee1a2913', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86456) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 10:30:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-1bee4d5c-87bc-4075-8d92-f84d3e2e0f13 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[977a29dd-a130-409a-9bf4-777e744210f8]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccbd8e9-c6fb-4cac-8de5-60b5127d5478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9', 'volume_size': 1, 'image_id': '7c152e43-1898-4fb5-a93a-23457b3c4d16', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c152e43-1898-4fb5-a93a-23457b3c4d16', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6116ee1ea0a169c8e133e72ee1a2913', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9edd2248fcc436bb3aeb9883f3c27e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b21eb0ac128d4fae69df9b6c10423908fbce808f338425d911c177fca0c3e5ecfaa98cae52aaa9aa7f4fd3f6750853318795ce842c6ab8187baf1a62cd9e7c82', 'id': '7c152e43-1898-4fb5-a93a-23457b3c4d16', 'created_at': datetime.datetime(2026, 7, 6, 8, 30, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 8, 30, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c152e43-1898-4fb5-a93a-23457b3c4d16/file', 'properties': {}}, 'image_service': }' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08410297-337c-40c6-b05d-caa44893d618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:46 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Volume volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 (de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9): created successfully Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08410297-337c-40c6-b05d-caa44893d618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:46 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 Jul 06 10:30:46 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Flow 'volume_create_manager' (d36defd8-9a6a-4b4e-ab47-1cd1c782073f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:46 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6e15d3d6-8a9a-4980-ad58-03e031e37ba9 tempest-VolumeImageDependencyTests-1387903775 None] Created volume successfully. Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Acquiring lock "cinder-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Lock "cinder-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Acquiring lock "cinder-quobyte-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Lock "cinder-quobyte-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[60077189-23ad-4d4e-b4b5-0d155aab1de4]: (4, 'raw') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:46 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63" returned: 0 in 0.864s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Creating direct copy from snapshot {{(pid=86456) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 10:30:46 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 Jul 06 10:30:46 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b17b0-2086-41c2-a819-79588102f4ac]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:47 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 Jul 06 10:30:47 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:47 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (71b96c9c-1ccc-4d65-b10b-6d51d9880b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aebfa0b-7ce7-4d96-a825-79ee839abf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" returned: 0 in 0.871s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aebfa0b-7ce7-4d96-a825-79ee839abf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918983292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee6e8a5-f788-45df-8933-e3cc9a650034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:48Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638db6f7-a0d2-4406-bff8-5e13519c12d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638db6f7-a0d2-4406-bff8-5e13519c12d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1bf51-d25a-4cf5-a702-0726d090e2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1bf51-d25a-4cf5-a702-0726d090e2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee6e8a5-f788-45df-8933-e3cc9a650034', 'volume_name': 'volume-2ee6e8a5-f788-45df-8933-e3cc9a650034', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26434534-4218-4088-9038-4425ec151bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26434534-4218-4088-9038-4425ec151bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe4a27f-b89f-4c41-a644-7cf71744d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:47 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Volume 2ee6e8a5-f788-45df-8933-e3cc9a650034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee6e8a5-f788-45df-8933-e3cc9a650034', 'volume_size': 1} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:47 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 Jul 06 10:30:47 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:47 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4" returned: 0 in 0.872s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG cinder.utils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Path /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac not found in is_blk_device check {{(pid=86456) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 10:30:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:47 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac Jul 06 10:30:47 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:48 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" returned: 1 in 0.752s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9' failed. Not Retrying. {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 10:30:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:48 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9 Jul 06 10:30:48 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:49 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" returned: 0 in 1.239s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Lock "cinder-quobyte-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9" released by "delete_volume" :: held 2.967s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:49 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Created reservations ['dd4186a2-14d9-4149-86bf-de45d3047b9d', 'c73bc975-ba6f-4f84-9fbf-e5edd421be4f', '73ffee32-24ae-4222-8b7f-b66d030038e7', '816a0a11-c7ee-498c-b9d8-b9b477c51d76'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:49 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:49 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:50 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:50 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:50 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:51 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 1.845s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:51 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:51 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Deleted volume successfully. Jul 06 10:30:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3b84511e-0277-42e2-ba27-1cf6b297c177 tempest-VolumeImageDependencyTests-1387903775 None] Lock "cinder-de3f7494-4d6a-49d5-89ac-9b8a7d1bb4a9-delete_volume" released by "delete_volume" :: held 5.224s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:53 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac" returned: 0 in 5.754s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:53 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af3bcd6-ec2e-4848-88f4-dc26826e4d77]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:53 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 Jul 06 10:30:53 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:54 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4" returned: 0 in 0.920s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:54 devstack cinder-volume[86456]: DEBUG cinder.image.image_utils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Image conversion details: src /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac {{(pid=86456) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 10:30:54 devstack cinder-volume[86456]: INFO cinder.image.image_utils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Converted 1024.00 MB image at 177.92 MB/s Jul 06 10:30:54 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac is being set with open permissions: ugo+rw Jul 06 10:30:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:54 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac Jul 06 10:30:54 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:54 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:30:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Flow 'volume_create_manager' (b0a4a909-aa50-4936-b4d1-5a46d7056262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2a370f-4e3b-41ff-8b0d-9199b0a3abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2a370f-4e3b-41ff-8b0d-9199b0a3abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c01d381-292f-4e0d-a29c-f283404de0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a07c3fc77ed44018544c6411eb964ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:55Z,use_quota=True,user_id='9aba0a5dcb9443e1a0dec91de223ee72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70dc09e-733a-4762-9a18-548c73b7d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70dc09e-733a-4762-9a18-548c73b7d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd667bb5-fdde-4fc0-98b5-c3f344adc41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd667bb5-fdde-4fc0-98b5-c3f344adc41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c01d381-292f-4e0d-a29c-f283404de0f8', 'volume_name': 'volume-2c01d381-292f-4e0d-a29c-f283404de0f8', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692107a6-48e8-4e03-a9dc-cc2b2116fb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692107a6-48e8-4e03-a9dc-cc2b2116fb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e30564e-b71c-4427-8218-5234c3b47cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:55 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Volume 2c01d381-292f-4e0d-a29c-f283404de0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c01d381-292f-4e0d-a29c-f283404de0f8', 'volume_size': 1} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:55 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac" returned: 0 in 0.627s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-891e3029-3563-40ec-8f6e-864c4c0b10ac" released by "_copy_volume_from_snapshot" :: held 9.175s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-672d1145-b20c-42f0-9f65-8bb9b985bb63-891e3029-3563-40ec-8f6e-864c4c0b10ac" released by "_create_volume_from_snapshot" :: held 9.226s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.275s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.701s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Creating offline snapshot eec6c11a-31bc-4904-ab7d-19d8cd706994 of volume 0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db70116e-ddc6-48ce-a44b-a08f152ef153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891e3029-3563-40ec-8f6e-864c4c0b10ac', 'volume_size': 1, 'snapshot_id': '672d1145-b20c-42f0-9f65-8bb9b985bb63'}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d55046-eafd-4aef-a08d-676d32990f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a2ef61-394e-4aca-b0b9-e1f7d632b94b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:55 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Volume volume-891e3029-3563-40ec-8f6e-864c4c0b10ac (891e3029-3563-40ec-8f6e-864c4c0b10ac): created successfully Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d55046-eafd-4aef-a08d-676d32990f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Flow 'volume_create_manager' (f0dab8ff-6c6c-4594-8880-d0e3fbbf2e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:30:55 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d746d4a1-ac5c-4ca0-912a-10fd68fea9db tempest-SnapshotDependencyTests-1095943949 None] Created volume successfully. Jul 06 10:30:55 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f Jul 06 10:30:55 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-672d1145-b20c-42f0-9f65-8bb9b985bb63-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-672d1145-b20c-42f0-9f65-8bb9b985bb63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-quobyte-21e92a5e-28f5-4572-ade1-b901b41d6fe4" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-21e92a5e-28f5-4572-ade1-b901b41d6fe4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-quobyte-672d1145-b20c-42f0-9f65-8bb9b985bb63" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-672d1145-b20c-42f0-9f65-8bb9b985bb63" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Deleting offline snapshot 672d1145-b20c-42f0-9f65-8bb9b985bb63 of volume 21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] snapshot_file for this snap is: volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6b0888-0acd-4aae-b02b-a881bfa94c44]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:55 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 Jul 06 10:30:55 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:56 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f" returned: 0 in 0.840s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:56 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 1G Jul 06 10:30:56 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:56 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63" returned: 0 in 0.843s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b24b6c-bcd7-4f8c-9371-d7c09ba0b072]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:56 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 Jul 06 10:30:56 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:56 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 1G" returned: 0 in 0.816s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0254f4cc-1528-40ae-8d97-ff3cb898912f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:56 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0254f4cc-1528-40ae-8d97-ff3cb898912f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 Jul 06 10:30:56 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:57 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4" returned: 0 in 0.808s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:57 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 Jul 06 10:30:57 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:57 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0254f4cc-1528-40ae-8d97-ff3cb898912f -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994" returned: 0 in 0.762s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:57 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 is being set with open permissions: ugo+rw Jul 06 10:30:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:57 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 Jul 06 10:30:57 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:58 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63" returned: 0 in 0.767s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:58 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63 Jul 06 10:30:58 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:58 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994" returned: 0 in 0.659s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:58 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.info Jul 06 10:30:58 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:58 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4.672d1145-b20c-42f0-9f65-8bb9b985bb63" returned: 0 in 0.659s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-672d1145-b20c-42f0-9f65-8bb9b985bb63" released by "_delete_snapshot" :: held 3.181s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-21e92a5e-28f5-4572-ade1-b901b41d6fe4" released by "delete_snapshot" :: held 3.206s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Created reservations ['1ba989b6-e930-431b-bb97-d3a9f700f879', '6c4a5ca3-8528-4148-b381-57b7274e8c18', 'e8bd4644-f7b9-46c3-99d1-8cba85a175f8', '57692178-f77a-45d1-8e05-63ef2cc27b9f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:30:58 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Delete snapshot completed successfully. Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2b6c7487-ac7a-456d-bc37-761f138697f8 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-672d1145-b20c-42f0-9f65-8bb9b985bb63-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:58 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.info" returned: 0 in 0.665s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:58 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.info is being set with open permissions: ugo+rw Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:59 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:30:59 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:59 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.info Jul 06 10:30:59 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:59 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.info" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.526s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.929s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918983292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee6e8a5-f788-45df-8933-e3cc9a650034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:48Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Creating volume 2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:30:59 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:30:59 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.743s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:30:59 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 1073741824 Jul 06 10:30:59 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:30:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0d579dc9-de2b-4c0f-b3c6-9094b9b50cb4 tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-21e92a5e-28f5-4572-ade1-b901b41d6fe4-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-21e92a5e-28f5-4572-ade1-b901b41d6fe4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-quobyte-21e92a5e-28f5-4572-ade1-b901b41d6fe4" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-21e92a5e-28f5-4572-ade1-b901b41d6fe4" acquired by "delete_volume" :: waited 0.012s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cdbef2-1e5b-4ec8-b250-9a9b227d9f5d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:30:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:00 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 Jul 06 10:31:00 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-eec6c11a-31bc-4904-ab7d-19d8cd706994-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Lock "cinder-eec6c11a-31bc-4904-ab7d-19d8cd706994-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-0254f4cc-1528-40ae-8d97-ff3cb898912f" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-0254f4cc-1528-40ae-8d97-ff3cb898912f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-eec6c11a-31bc-4904-ab7d-19d8cd706994" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-eec6c11a-31bc-4904-ab7d-19d8cd706994" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot eec6c11a-31bc-4904-ab7d-19d8cd706994 of volume 0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5175bde-e35b-46b1-ae8a-62bfc881935e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:00 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 Jul 06 10:31:00 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:00 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 1073741824" returned: 0 in 1.034s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:00 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4" returned: 0 in 0.830s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:00 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 Jul 06 10:31:00 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:00 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4 Jul 06 10:31:00 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:01 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994" returned: 0 in 0.848s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0254f4cc-1528-40ae-8d97-ff3cb898912f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9ff63-0031-421e-888d-c84c1ecd94c1]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:01 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f Jul 06 10:31:01 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:01 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-21e92a5e-28f5-4572-ade1-b901b41d6fe4" returned: 0 in 0.679s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:01 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-21e92a5e-28f5-4572-ade1-b901b41d6fe4" released by "delete_volume" :: held 1.585s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034" returned: 0 in 0.732s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.464s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c01d381-292f-4e0d-a29c-f283404de0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a07c3fc77ed44018544c6411eb964ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:30:55Z,use_quota=True,user_id='9aba0a5dcb9443e1a0dec91de223ee72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Creating volume 2c01d381-292f-4e0d-a29c-f283404de0f8 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:31:01 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:01 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 1073741824 Jul 06 10:31:01 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe4a27f-b89f-4c41-a644-7cf71744d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee6e8a5-f788-45df-8933-e3cc9a650034', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460c184d-dcba-4542-8b29-fc6a90160137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:01 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Volume volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 (2ee6e8a5-f788-45df-8933-e3cc9a650034): created successfully Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460c184d-dcba-4542-8b29-fc6a90160137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (71b96c9c-1ccc-4d65-b10b-6d51d9880b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:01 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f52e7d32-4be4-4759-b2c8-d51da8879eb3 tempest-ProjectReaderTests-496383587 None] Created volume successfully. Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Created reservations ['4f37025a-afa2-4bca-92be-ec0e69044e6c', '833453ac-5e31-4e43-abfb-99c3528c1c86', 'a9b4c44d-f6e1-40b1-8c62-88f53281985a', '096f4384-3e6c-440c-9065-8a93f1f35427'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:01 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:01 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-891e3029-3563-40ec-8f6e-864c4c0b10ac-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-891e3029-3563-40ec-8f6e-864c4c0b10ac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:02 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "cinder-quobyte-891e3029-3563-40ec-8f6e-864c4c0b10ac" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f" returned: 0 in 1.066s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-891e3029-3563-40ec-8f6e-864c4c0b10ac" acquired by "delete_volume" :: waited 0.043s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:02 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 Jul 06 10:31:02 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4730b5-7e76-48f0-aff4-e75fa4175f90]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:02 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac Jul 06 10:31:02 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:02 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.892s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:02 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Deleted volume successfully. Jul 06 10:31:02 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 1073741824" returned: 0 in 1.107s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-79393918-4657-45dc-bf4e-d4c9306ea7d3 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-21e92a5e-28f5-4572-ade1-b901b41d6fe4-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:02 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 Jul 06 10:31:02 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:03 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994" returned: 0 in 0.938s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:03 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994 Jul 06 10:31:03 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:03 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac" returned: 0 in 0.907s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:03 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac Jul 06 10:31:03 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:03 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8" returned: 0 in 0.713s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.229s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Creating offline snapshot cd6c524c-a998-4084-a453-f0be272a7e8c of volume 2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e30564e-b71c-4427-8218-5234c3b47cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c01d381-292f-4e0d-a29c-f283404de0f8', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f48377-465b-42e3-8440-118f910cd716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aaca7a-a19a-4756-b79e-ade26c1c3d00]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Volume volume-2c01d381-292f-4e0d-a29c-f283404de0f8 (2c01d381-292f-4e0d-a29c-f283404de0f8): created successfully Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f48377-465b-42e3-8440-118f910cd716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Flow 'volume_create_manager' (b0a4a909-aa50-4936-b4d1-5a46d7056262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-dc65d53c-d484-4f46-9d63-0ba183944c5e tempest-CinderUnicodeTest-1121171813 None] Created volume successfully. Jul 06 10:31:03 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 Jul 06 10:31:03 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:03 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-891e3029-3563-40ec-8f6e-864c4c0b10ac" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-quobyte-891e3029-3563-40ec-8f6e-864c4c0b10ac" released by "delete_volume" :: held 1.630s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:03 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f.eec6c11a-31bc-4904-ab7d-19d8cd706994" returned: 0 in 0.752s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-eec6c11a-31bc-4904-ab7d-19d8cd706994" released by "_delete_snapshot" :: held 3.723s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-0254f4cc-1528-40ae-8d97-ff3cb898912f" released by "delete_snapshot" :: held 3.755s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Created reservations ['84dc6101-9e06-4a6b-82d8-f19df30a4f7a', '26e5258e-d68c-403f-924c-41f3007f097d', '5636a46f-05ee-4e90-8f3c-9e869ae72680', '827088a8-68fe-4a2a-8f9c-57ec1c5123fb'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:04 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:04 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Created reservations ['3b3935e7-6feb-49e5-93ea-20ab347fb47a', 'd8921186-dded-4b3a-87a0-e6b3b5c9e998', '19ee272a-5209-46a4-96a4-decaefc14005', '02a423fe-8210-4baa-bbc7-d6d5184835d9'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:04 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f787807b-c4b1-4ba9-99ff-2b1c0d67dfbe tempest-ProjectMemberTests-97035211 None] Lock "cinder-eec6c11a-31bc-4904-ab7d-19d8cd706994-delete_snapshot" released by "delete_snapshot" :: held 4.011s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:04 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034" returned: 0 in 0.880s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:04 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c 1G Jul 06 10:31:04 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-0254f4cc-1528-40ae-8d97-ff3cb898912f-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Lock "cinder-0254f4cc-1528-40ae-8d97-ff3cb898912f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-0254f4cc-1528-40ae-8d97-ff3cb898912f" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-0254f4cc-1528-40ae-8d97-ff3cb898912f" acquired by "delete_volume" :: waited 0.033s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3c46b-56c4-47fc-a297-b45ed036d5bb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:04 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f Jul 06 10:31:04 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:04 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.882s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:04 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Deleted volume successfully. Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a2e2410a-00d2-487a-aca7-0997cd663008 tempest-SnapshotDependencyTests-1095943949 None] Lock "cinder-891e3029-3563-40ec-8f6e-864c4c0b10ac-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:05 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c 1G" returned: 0 in 1.069s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:05 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c Jul 06 10:31:05 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Flow 'volume_create_manager' (486fdfc0-3e2c-49a8-92b1-f5a445766a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0853502-0f90-4e9e-ad99-bd4bfad22cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0853502-0f90-4e9e-ad99-bd4bfad22cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1641077725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e321e8-2a7e-48f3-9713-b41ac7c5e5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a07c3fc77ed44018544c6411eb964ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:05Z,use_quota=True,user_id='9aba0a5dcb9443e1a0dec91de223ee72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df3c7ff-cfd6-4f5d-9ad8-727f6f1d2fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df3c7ff-cfd6-4f5d-9ad8-727f6f1d2fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b269064-7a0a-4205-9d73-de17278ca4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b269064-7a0a-4205-9d73-de17278ca4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e321e8-2a7e-48f3-9713-b41ac7c5e5a7', 'volume_name': 'volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce45517-e721-4d2c-b200-d486c8f290ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce45517-e721-4d2c-b200-d486c8f290ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2e3b1c-c80b-4776-b132-40cb7a168a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Volume 34e321e8-2a7e-48f3-9713-b41ac7c5e5a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7', 'volume_size': 1} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:05 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f" returned: 0 in 1.082s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:05 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f Jul 06 10:31:05 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c" returned: 0 in 0.926s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:06 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c is being set with open permissions: ugo+rw Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:06 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:06 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c Jul 06 10:31:06 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:06 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-0254f4cc-1528-40ae-8d97-ff3cb898912f" returned: 0 in 0.789s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-0254f4cc-1528-40ae-8d97-ff3cb898912f" released by "delete_volume" :: held 1.986s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Created reservations ['52819dff-bdf0-4e0c-a911-b00d4b13b6c3', 'a94e34cf-5de8-4989-b5d4-e61d1937111c', '07191ae5-589d-42c4-b94e-83eef0283b81', '0ed57d40-e492-43dc-9c80-4023e457bed2'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:06 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:06 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:07 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c" returned: 0 in 0.749s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:07 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.info Jul 06 10:31:07 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (ed23bb5f-f56f-4523-8c9d-0e094575cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b400e7-91f8-4f4f-bc6f-958d1a344bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b400e7-91f8-4f4f-bc6f-958d1a344bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440481045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a26859-9d79-4e2a-bb61-66666188004a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:07Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d08be1-9d8c-4dac-a28d-d1b671508662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d08be1-9d8c-4dac-a28d-d1b671508662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c600e947-c546-4a0d-8a9a-c04f228ab8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c600e947-c546-4a0d-8a9a-c04f228ab8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a26859-9d79-4e2a-bb61-66666188004a', 'volume_name': 'volume-00a26859-9d79-4e2a-bb61-66666188004a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524e5b0c-1be8-496f-afe6-bcea58cb3d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524e5b0c-1be8-496f-afe6-bcea58cb3d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ae662f-f1e6-4bfe-be78-f117571f3125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:07 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Volume 00a26859-9d79-4e2a-bb61-66666188004a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a26859-9d79-4e2a-bb61-66666188004a', 'volume_size': 1} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:07 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.915s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:07 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:31:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-22e19d34-2c10-493f-90ef-d73235282bd4 tempest-ProjectMemberTests-97035211 None] Lock "cinder-0254f4cc-1528-40ae-8d97-ff3cb898912f-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:08 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.info" returned: 0 in 1.022s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:08 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.info is being set with open permissions: ugo+rw Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:08 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.info Jul 06 10:31:08 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:08 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.info" returned: 0 in 0.740s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.514s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.206s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1641077725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e321e8-2a7e-48f3-9713-b41ac7c5e5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a07c3fc77ed44018544c6411eb964ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:05Z,use_quota=True,user_id='9aba0a5dcb9443e1a0dec91de223ee72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Creating volume 34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:31:08 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:31:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:08 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 1073741824 Jul 06 10:31:08 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3990b809-3a6e-4519-b1e2-34cf8ab4852b tempest-ProjectReaderTests-496383587 None] Create snapshot completed successfully Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-cd6c524c-a998-4084-a453-f0be272a7e8c-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Lock "cinder-cd6c524c-a998-4084-a453-f0be272a7e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-2ee6e8a5-f788-45df-8933-e3cc9a650034" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-2ee6e8a5-f788-45df-8933-e3cc9a650034" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-cd6c524c-a998-4084-a453-f0be272a7e8c" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-cd6c524c-a998-4084-a453-f0be272a7e8c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Deleting offline snapshot cd6c524c-a998-4084-a453-f0be272a7e8c of volume 2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] snapshot_file for this snap is: volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386f7a0-76df-467f-b6b3-7378f3e83911]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:09 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c Jul 06 10:31:09 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:09 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 1073741824" returned: 0 in 1.019s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:10 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 Jul 06 10:31:10 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:10 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c" returned: 0 in 0.870s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee6e8a5-f788-45df-8933-e3cc9a650034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7766043-ac42-49a6-b05a-a6b0ea6588c3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:10 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" returned: 0 in 0.804s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:10 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.149s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440481045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a26859-9d79-4e2a-bb61-66666188004a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:07Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:31:10 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Creating volume 00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:31:10 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:10 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a 1073741824 Jul 06 10:31:10 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2e3b1c-c80b-4776-b132-40cb7a168a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bb3821-8d99-42ba-912d-2b5d609eefae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:10 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Volume volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 (34e321e8-2a7e-48f3-9713-b41ac7c5e5a7): created successfully Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bb3821-8d99-42ba-912d-2b5d609eefae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Flow 'volume_create_manager' (486fdfc0-3e2c-49a8-92b1-f5a445766a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f2fc7381-fc4e-4bc7-8c1a-6071d4b70ca5 tempest-CinderUnicodeTest-1121171813 None] Created volume successfully. Jul 06 10:31:11 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034" returned: 0 in 0.854s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:11 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c Jul 06 10:31:11 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:11 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a 1073741824" returned: 0 in 0.965s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:11 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a Jul 06 10:31:11 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:12 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c" returned: 0 in 1.071s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:12 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c Jul 06 10:31:12 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:12 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a" returned: 0 in 0.822s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.365s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ae662f-f1e6-4bfe-be78-f117571f3125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a26859-9d79-4e2a-bb61-66666188004a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6407cca-e9b2-48f5-acee-5a701a8f5987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Creating offline snapshot a3637623-294a-4466-a955-d96ae2073329 of volume 34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:31:12 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Volume volume-00a26859-9d79-4e2a-bb61-66666188004a (00a26859-9d79-4e2a-bb61-66666188004a): created successfully Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6407cca-e9b2-48f5-acee-5a701a8f5987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (ed23bb5f-f56f-4523-8c9d-0e094575cf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[730bd321-0918-452a-9723-20b469b95fa6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:12 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-af3bdbcf-3e76-4101-be0f-f52b828af4c3 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:31:12 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 Jul 06 10:31:12 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:13 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034.cd6c524c-a998-4084-a453-f0be272a7e8c" returned: 0 in 0.728s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-cd6c524c-a998-4084-a453-f0be272a7e8c" released by "_delete_snapshot" :: held 3.654s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-2ee6e8a5-f788-45df-8933-e3cc9a650034" released by "delete_snapshot" :: held 3.688s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Created reservations ['688151bb-27df-4992-89f8-168fb5ef1c2b', 'b58a8946-45c6-4663-82ce-dd6bf7560738', '30f9e8a4-2153-4d63-b704-9bdf307e7ad2', '880314ab-2b58-42ac-b34f-d6f1cf546ccc'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Delete snapshot completed successfully. Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-210fe2b5-3ae6-441a-9c06-29903aa96c05 tempest-ProjectReaderTests-496383587 None] Lock "cinder-cd6c524c-a998-4084-a453-f0be272a7e8c-delete_snapshot" released by "delete_snapshot" :: held 3.858s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:13 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" returned: 0 in 0.924s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:13 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 1G Jul 06 10:31:13 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-2ee6e8a5-f788-45df-8933-e3cc9a650034-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Lock "cinder-2ee6e8a5-f788-45df-8933-e3cc9a650034-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-2ee6e8a5-f788-45df-8933-e3cc9a650034" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:14 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-2ee6e8a5-f788-45df-8933-e3cc9a650034" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:14 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25a4d7-9022-4a53-a1c9-3804bb73cf9e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:14 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 Jul 06 10:31:14 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:14 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 1G" returned: 0 in 1.057s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:14 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 Jul 06 10:31:14 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:15 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034" returned: 0 in 0.951s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:15 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034 Jul 06 10:31:15 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:15 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329" returned: 0 in 0.848s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:15 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 is being set with open permissions: ugo+rw Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:15 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 Jul 06 10:31:15 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:15 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2ee6e8a5-f788-45df-8933-e3cc9a650034" returned: 0 in 0.715s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-2ee6e8a5-f788-45df-8933-e3cc9a650034" released by "delete_volume" :: held 1.773s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Created reservations ['cc5b630c-661c-411b-8dc6-1f0b6b2ec6e0', 'f0c215f2-63a7-4dda-952b-1ba3fe0ad9c6', 'fe373212-889b-4ca6-8d68-310bb2fb99d3', '8525ad9b-6f44-4451-9852-fc18b26cf156'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:16 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:16 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:16 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329" returned: 0 in 0.693s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:16 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.info Jul 06 10:31:16 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (f9630d75-ed85-4eaf-83c7-3ed367d7f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aef6ac-7dda-434d-9d98-a7d7435b64bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aef6ac-7dda-434d-9d98-a7d7435b64bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875055668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e6eb20-4151-439c-8d43-ea0fd51837e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:17Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bc13ac-0677-40fb-9533-91ad498316a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bc13ac-0677-40fb-9533-91ad498316a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fd08c4-ccaa-484b-aa47-2a25b9c19b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fd08c4-ccaa-484b-aa47-2a25b9c19b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e6eb20-4151-439c-8d43-ea0fd51837e8', 'volume_name': 'volume-86e6eb20-4151-439c-8d43-ea0fd51837e8', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a102587c-6033-4a98-a41c-d141ff2e4317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a102587c-6033-4a98-a41c-d141ff2e4317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6320ef4-edbe-44ee-8afc-fce1ea71a786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:16 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Volume 86e6eb20-4151-439c-8d43-ea0fd51837e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e6eb20-4151-439c-8d43-ea0fd51837e8', 'volume_size': 1} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:16 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.757s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Deleted volume successfully. Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-20607511-5e3b-4f4c-a82f-cd63f100e677 tempest-ProjectReaderTests-496383587 None] Lock "cinder-2ee6e8a5-f788-45df-8933-e3cc9a650034-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:16 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.info" returned: 0 in 0.677s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:16 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.info is being set with open permissions: ugo+rw Jul 06 10:31:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:16 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.info Jul 06 10:31:16 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:17 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.info" returned: 0 in 0.633s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.956s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.398s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:17 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=123,cinder:INSERT=38,cinder:UPDATE=137,cinder:DELETE=12 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:31:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Creating offline snapshot c2725cde-f09c-48f7-a526-0f95b58ae533 of volume 00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:31:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[827e4dce-4ca0-45e1-b6c0-d10a2ffbdea2]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:17 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3347b1ff-7f58-42a2-be8c-dc793f3ebdd9 tempest-CinderUnicodeTest-1121171813 None] Create snapshot completed successfully Jul 06 10:31:17 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a Jul 06 10:31:17 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:18 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:18 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 1G Jul 06 10:31:18 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "cinder-a3637623-294a-4466-a955-d96ae2073329-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-a3637623-294a-4466-a955-d96ae2073329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "cinder-quobyte-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "cinder-quobyte-a3637623-294a-4466-a955-d96ae2073329" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-a3637623-294a-4466-a955-d96ae2073329" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Deleting offline snapshot a3637623-294a-4466-a955-d96ae2073329 of volume 34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] snapshot_file for this snap is: volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea148549-e0b5-4204-9941-9f12a6c95766]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:18 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 Jul 06 10:31:18 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:19 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 1G" returned: 0 in 0.809s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a26859-9d79-4e2a-bb61-66666188004a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:19 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a26859-9d79-4e2a-bb61-66666188004a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 Jul 06 10:31:19 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:19 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329" returned: 0 in 0.778s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd5f02-c6b4-4eb1-af83-8e385f0a591b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:19 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 Jul 06 10:31:19 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:19 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00a26859-9d79-4e2a-bb61-66666188004a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533" returned: 0 in 0.693s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:19 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 is being set with open permissions: ugo+rw Jul 06 10:31:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:19 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 Jul 06 10:31:19 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:20 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" returned: 0 in 0.786s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:20 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 Jul 06 10:31:20 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:20 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533" returned: 0 in 0.662s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:20 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:DELETE=13,cinder:UPDATE=147,cinder:SELECT=110,cinder:INSERT=44 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:31:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:20 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.info Jul 06 10:31:20 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:21 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329" returned: 0 in 0.749s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:21 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329 Jul 06 10:31:21 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:21 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.info" returned: 0 in 0.654s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:21 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.info is being set with open permissions: ugo+rw Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:21 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.info Jul 06 10:31:21 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:21 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7.a3637623-294a-4466-a955-d96ae2073329" returned: 0 in 0.641s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-a3637623-294a-4466-a955-d96ae2073329" released by "_delete_snapshot" :: held 3.057s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" released by "delete_snapshot" :: held 3.088s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Created reservations ['46211a27-100f-4233-a9f3-5fd62e58918c', 'c9618201-561b-4803-8cb1-b5a38eb809e3', '84ef81c0-f305-4b3c-8170-45ed04f0c8c7', '4fe36eb3-5c4d-48f6-914d-da22da38b0c5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:21 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.info" returned: 0 in 0.644s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.308s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.179s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875055668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e6eb20-4151-439c-8d43-ea0fd51837e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:17Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Creating volume 86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:31:21 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:31:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:21 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 1073741824 Jul 06 10:31:21 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f09d1576-b145-445b-b06b-8edb7e16fae2 tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:31:21 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Delete snapshot completed successfully. Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-69cb23c0-3c03-4e50-969d-1973cb60438d tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-a3637623-294a-4466-a955-d96ae2073329-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-c2725cde-f09c-48f7-a526-0f95b58ae533-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Lock "cinder-c2725cde-f09c-48f7-a526-0f95b58ae533-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-00a26859-9d79-4e2a-bb61-66666188004a" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-00a26859-9d79-4e2a-bb61-66666188004a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-c2725cde-f09c-48f7-a526-0f95b58ae533" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-c2725cde-f09c-48f7-a526-0f95b58ae533" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot c2725cde-f09c-48f7-a526-0f95b58ae533 of volume 00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0a4642-fe57-4882-b98e-a44d17126581]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:22 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 Jul 06 10:31:22 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:22 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 1073741824" returned: 0 in 0.859s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:22 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 Jul 06 10:31:22 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "cinder-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "cinder-quobyte-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f373e52-2485-4be4-8e27-9296f6218506]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:23 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 Jul 06 10:31:23 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:23 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533" returned: 0 in 0.833s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00a26859-9d79-4e2a-bb61-66666188004a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ed2ebc-0e76-49af-92b2-56ff4a1cf146]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:23 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8" returned: 0 in 0.680s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6320ef4-edbe-44ee-8afc-fce1ea71a786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e6eb20-4151-439c-8d43-ea0fd51837e8', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d7e955-c943-4c7e-81df-43de6daeb696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Volume volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 (86e6eb20-4151-439c-8d43-ea0fd51837e8): created successfully Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78d7e955-c943-4c7e-81df-43de6daeb696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (f9630d75-ed85-4eaf-83c7-3ed367d7f70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-61f9a5d0-1d8a-4d58-8287-deb578376b19 tempest-ProjectReaderTests-496383587 None] Created volume successfully. Jul 06 10:31:23 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a Jul 06 10:31:23 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:23 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" returned: 0 in 0.771s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:23 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7 Jul 06 10:31:23 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:24 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a" returned: 0 in 0.828s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:24 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 Jul 06 10:31:24 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Creating offline snapshot 9242dcfa-73c6-4000-ba39-73cdef5bb751 of volume 86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[21daf306-3c4b-4cc2-a08a-8211dc9897df]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:24 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 Jul 06 10:31:24 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:24 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" returned: 0 in 0.662s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7" released by "delete_volume" :: held 1.495s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Created reservations ['b2511d45-692d-49db-ac73-d3e5eb4cea89', 'e1993cc9-937d-416d-aeec-3aefec0ac5f8', '80124762-c002-4a91-9005-84a716f63b9d', '0712c130-e2bb-4f0f-8832-28ca80e299ba'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:24 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:24 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:25 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533" returned: 0 in 0.813s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:25 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533 Jul 06 10:31:25 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:25 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8" returned: 0 in 0.859s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "cinder-2c01d381-292f-4e0d-a29c-f283404de0f8-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:25 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 1G Jul 06 10:31:25 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-2c01d381-292f-4e0d-a29c-f283404de0f8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "cinder-quobyte-2c01d381-292f-4e0d-a29c-f283404de0f8" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-2c01d381-292f-4e0d-a29c-f283404de0f8" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[c046089b-7687-41ea-a5bd-eb48ac5a6cfe]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:25 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.765s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Deleted volume successfully. Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-f2bbff4f-96e7-4f7e-a741-673ec22b68d3 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-34e321e8-2a7e-48f3-9713-b41ac7c5e5a7-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:25 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 Jul 06 10:31:25 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:25 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a.c2725cde-f09c-48f7-a526-0f95b58ae533" returned: 0 in 0.803s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-c2725cde-f09c-48f7-a526-0f95b58ae533" released by "_delete_snapshot" :: held 3.371s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-00a26859-9d79-4e2a-bb61-66666188004a" released by "delete_snapshot" :: held 3.396s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Created reservations ['e025caf0-5f64-4bfa-a040-dfa7ffef2b47', '44ceb715-6a14-4ca5-beb1-8c193cba0afe', '84221b73-aef6-42ba-a81b-00d645c998e8', '532992e2-9be2-4006-b8dd-13f7a870cda5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:26 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d0612321-4a0d-425e-a098-2623c1e49e05 tempest-ProjectMemberTests-97035211 None] Lock "cinder-c2725cde-f09c-48f7-a526-0f95b58ae533-delete_snapshot" released by "delete_snapshot" :: held 3.553s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:26 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:26 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8" returned: 0 in 0.890s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 1G" returned: 0 in 1.076s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:26 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8 Jul 06 10:31:26 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:26 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 Jul 06 10:31:26 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-00a26859-9d79-4e2a-bb61-66666188004a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Lock "cinder-00a26859-9d79-4e2a-bb61-66666188004a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-00a26859-9d79-4e2a-bb61-66666188004a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-00a26859-9d79-4e2a-bb61-66666188004a" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[98220406-ead8-4809-b677-4c4c3af73c14]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:26 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2c01d381-292f-4e0d-a29c-f283404de0f8" returned: 0 in 0.692s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-quobyte-2c01d381-292f-4e0d-a29c-f283404de0f8" released by "delete_volume" :: held 1.643s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Created reservations ['613844ad-a6a5-4537-ae05-4ea2f05936d9', 'e0375443-dc2e-41bb-9736-c4613011017b', '31d49869-601c-4f00-b555-e0cd8df02556', '1e47fdf2-40eb-4ed5-9655-e8999c3dae48'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:27 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a Jul 06 10:31:27 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:27 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751" returned: 0 in 0.811s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:27 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 is being set with open permissions: ugo+rw Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:27 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 Jul 06 10:31:27 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:27 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:27 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:27 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751" returned: 0 in 0.698s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:27 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a" returned: 0 in 0.883s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:27 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a Jul 06 10:31:27 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:27 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.info Jul 06 10:31:27 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:27 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.751s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:27 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Deleted volume successfully. Jul 06 10:31:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-7ec5a6b1-72b9-4814-ba9d-bf35dccda5c0 tempest-CinderUnicodeTest-1121171813 None] Lock "cinder-2c01d381-292f-4e0d-a29c-f283404de0f8-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:28 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-00a26859-9d79-4e2a-bb61-66666188004a" returned: 0 in 0.740s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-00a26859-9d79-4e2a-bb61-66666188004a" released by "delete_volume" :: held 1.694s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:28 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.info" returned: 0 in 0.764s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:28 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.info is being set with open permissions: ugo+rw Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:28 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.info Jul 06 10:31:28 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Created reservations ['25012569-0de2-4bfd-98b7-08115a0b2d33', 'd9711a1d-2a97-40a1-a5ff-70e0e27d40b1', '8831d04d-6be8-4d36-93a0-77f4039f4807', 'e20d670a-bbb1-4ce7-8631-bc8498a3d52e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:28 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:28 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:29 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.info" returned: 0 in 0.852s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.170s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-97e4265a-a306-4864-a3b6-8d43b1a61c31 tempest-ProjectReaderTests-496383587 None] Create snapshot completed successfully Jul 06 10:31:29 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.862s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a639398b-33dd-4059-b16e-5a2c28d1e5be tempest-ProjectMemberTests-97035211 None] Lock "cinder-00a26859-9d79-4e2a-bb61-66666188004a-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (8d3f3248-3a53-4047-996f-a360f9dfd880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f27caa-d858-4bc2-89c0-85903db262e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f27caa-d858-4bc2-89c0-85903db262e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1247473443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5630f7a6-c57c-409a-9472-e35b45e87701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:30Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a66af09-4051-47fe-8e47-cca05c07d3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a66af09-4051-47fe-8e47-cca05c07d3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993cfb8a-ced9-4f6c-bdbd-1d192711fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993cfb8a-ced9-4f6c-bdbd-1d192711fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5630f7a6-c57c-409a-9472-e35b45e87701', 'volume_name': 'volume-5630f7a6-c57c-409a-9472-e35b45e87701', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1ab2d2-e34e-40b4-a80d-299acf6f0ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1ab2d2-e34e-40b4-a80d-299acf6f0ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c236315f-3907-43a5-abd9-8a80ace50d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Volume 5630f7a6-c57c-409a-9472-e35b45e87701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5630f7a6-c57c-409a-9472-e35b45e87701', 'volume_size': 1} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1247473443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5630f7a6-c57c-409a-9472-e35b45e87701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:30Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Creating volume 5630f7a6-c57c-409a-9472-e35b45e87701 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:31:29 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:31:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:29 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701 1073741824 Jul 06 10:31:29 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-9242dcfa-73c6-4000-ba39-73cdef5bb751-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Lock "cinder-9242dcfa-73c6-4000-ba39-73cdef5bb751-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-86e6eb20-4151-439c-8d43-ea0fd51837e8" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-86e6eb20-4151-439c-8d43-ea0fd51837e8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-9242dcfa-73c6-4000-ba39-73cdef5bb751" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-9242dcfa-73c6-4000-ba39-73cdef5bb751" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Deleting offline snapshot 9242dcfa-73c6-4000-ba39-73cdef5bb751 of volume 86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:31:30 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] snapshot_file for this snap is: volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701 1073741824" returned: 0 in 0.960s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c77c22d-7441-4999-9781-2feecc2cec50]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:30 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701 Jul 06 10:31:30 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:30 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 Jul 06 10:31:30 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:31 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701" returned: 0 in 0.748s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c236315f-3907-43a5-abd9-8a80ace50d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5630f7a6-c57c-409a-9472-e35b45e87701', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fe10f0-3020-4daf-83fa-c868f7bf036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:31 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Volume volume-5630f7a6-c57c-409a-9472-e35b45e87701 (5630f7a6-c57c-409a-9472-e35b45e87701): created successfully Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fe10f0-3020-4daf-83fa-c868f7bf036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (8d3f3248-3a53-4047-996f-a360f9dfd880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:31 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:31 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-16070184-30ac-4df3-9fc7-4bd46b082c23 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751" returned: 0 in 0.858s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86e6eb20-4151-439c-8d43-ea0fd51837e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1d8239-c052-4628-a206-c62959950b27]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:31 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 Jul 06 10:31:31 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Creating offline snapshot 9cc76ab0-2909-48e6-91b6-576134eee4bd of volume 5630f7a6-c57c-409a-9472-e35b45e87701 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9c596b-7d8c-41d8-8052-630fde9f2532]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:32 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701 Jul 06 10:31:32 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:32 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8" returned: 0 in 0.847s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:32 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 Jul 06 10:31:32 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:32 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701" returned: 0 in 0.820s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:32 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd 1G Jul 06 10:31:32 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:33 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751" returned: 0 in 0.830s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:33 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751 Jul 06 10:31:33 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:33 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd 1G" returned: 0 in 0.946s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5630f7a6-c57c-409a-9472-e35b45e87701 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:33 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5630f7a6-c57c-409a-9472-e35b45e87701 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd Jul 06 10:31:33 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:34 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8.9242dcfa-73c6-4000-ba39-73cdef5bb751" returned: 0 in 0.768s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-9242dcfa-73c6-4000-ba39-73cdef5bb751" released by "_delete_snapshot" :: held 3.420s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-86e6eb20-4151-439c-8d43-ea0fd51837e8" released by "delete_snapshot" :: held 3.447s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Created reservations ['78358788-76bb-44df-a871-960f696cea00', 'e41d264d-7b5d-423d-b431-c2350f4cb38f', 'f92fbd1b-a798-40a2-9c82-e382cdd3fc11', '2e8444e9-a7a4-4f70-abe7-f2ec59104382'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Delete snapshot completed successfully. Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-ffc98709-5145-482d-ac13-987f95462be2 tempest-ProjectReaderTests-496383587 None] Lock "cinder-9242dcfa-73c6-4000-ba39-73cdef5bb751-delete_snapshot" released by "delete_snapshot" :: held 3.622s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:34 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5630f7a6-c57c-409a-9472-e35b45e87701 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd" returned: 0 in 0.818s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:34 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd is being set with open permissions: ugo+rw Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:34 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd Jul 06 10:31:34 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-86e6eb20-4151-439c-8d43-ea0fd51837e8-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Lock "cinder-86e6eb20-4151-439c-8d43-ea0fd51837e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-86e6eb20-4151-439c-8d43-ea0fd51837e8" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-86e6eb20-4151-439c-8d43-ea0fd51837e8" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e689c482-d1d9-4c18-a938-fb9660166333]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:35 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 Jul 06 10:31:35 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:35 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.9cc76ab0-2909-48e6-91b6-576134eee4bd" returned: 0 in 0.704s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:35 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.info Jul 06 10:31:35 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:35 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8" returned: 0 in 0.836s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:35 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8 Jul 06 10:31:35 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:35 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.info" returned: 0 in 0.679s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:35 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.info is being set with open permissions: ugo+rw Jul 06 10:31:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:35 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.info Jul 06 10:31:35 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:36 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-86e6eb20-4151-439c-8d43-ea0fd51837e8" returned: 0 in 0.764s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-86e6eb20-4151-439c-8d43-ea0fd51837e8" released by "delete_volume" :: held 1.677s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:36 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-5630f7a6-c57c-409a-9472-e35b45e87701.info" returned: 0 in 0.763s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.816s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Created reservations ['afe194da-cdc6-46dc-bc63-69b2f0b51dc9', '2c014bad-e737-46e2-8408-62661e096b34', '509ab0c6-e662-4463-b6b7-a0d93e7a0db8', 'ecb58d7d-03db-4c61-b381-85281e1e8b07'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:31:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-53fd0ba3-6cf4-4633-b3bb-620d424f4678 tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:36 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:36 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-685f3d06-d43f-41dc-acbc-657fe6f8b32e tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-9cc76ab0-2909-48e6-91b6-576134eee4bd-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-685f3d06-d43f-41dc-acbc-657fe6f8b32e tempest-ProjectMemberTests-97035211 None] Lock "cinder-9cc76ab0-2909-48e6-91b6-576134eee4bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:37 devstack cinder-volume[86456]: INFO cinder.message.api [None req-685f3d06-d43f-41dc-acbc-657fe6f8b32e tempest-ProjectMemberTests-97035211 None] Creating message record for request_id = req-685f3d06-d43f-41dc-acbc-657fe6f8b32e Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-685f3d06-d43f-41dc-acbc-657fe6f8b32e tempest-ProjectMemberTests-97035211 None] Lock "cinder-9cc76ab0-2909-48e6-91b6-576134eee4bd-delete_snapshot" released by "delete_snapshot" :: held 0.046s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server [None req-685f3d06-d43f-41dc-acbc-657fe6f8b32e tempest-ProjectMemberTests-97035211 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 10:31:37 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server Jul 06 10:31:37 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.725s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Deleted volume successfully. Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-cb50bf97-5e42-46fe-b45a-6603d8f1b9eb tempest-ProjectReaderTests-496383587 None] Lock "cinder-86e6eb20-4151-439c-8d43-ea0fd51837e8-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (80495db8-e041-4ed3-aec5-647386a7d537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd26a2f-e6f1-4e8b-aa9d-55ada266ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd26a2f-e6f1-4e8b-aa9d-55ada266ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701069283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fa2e0e-d657-4881-862e-33effea29d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:38Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cacadfd-c388-466f-b514-f3a49162fa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cacadfd-c388-466f-b514-f3a49162fa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae75f7c0-3798-49c5-a581-1eac68dbbb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae75f7c0-3798-49c5-a581-1eac68dbbb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fa2e0e-d657-4881-862e-33effea29d16', 'volume_name': 'volume-46fa2e0e-d657-4881-862e-33effea29d16', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e42d53-bf69-4700-afa8-bf552932a666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e42d53-bf69-4700-afa8-bf552932a666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd907e79-c3d9-492a-b897-a0ced7b4bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Volume 46fa2e0e-d657-4881-862e-33effea29d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fa2e0e-d657-4881-862e-33effea29d16', 'volume_size': 1} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701069283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fa2e0e-d657-4881-862e-33effea29d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:31:38Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Creating volume 46fa2e0e-d657-4881-862e-33effea29d16 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:31:37 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:31:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:37 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16 1073741824 Jul 06 10:31:37 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:38 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16 1073741824" returned: 0 in 0.870s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:38 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16 Jul 06 10:31:38 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:39 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16" returned: 0 in 0.657s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd907e79-c3d9-492a-b897-a0ced7b4bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fa2e0e-d657-4881-862e-33effea29d16', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8a6457-3cd1-46fc-84a0-294e0519238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:31:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Volume volume-46fa2e0e-d657-4881-862e-33effea29d16 (46fa2e0e-d657-4881-862e-33effea29d16): created successfully Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8a6457-3cd1-46fc-84a0-294e0519238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (80495db8-e041-4ed3-aec5-647386a7d537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:31:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-cd5ecb71-e269-4c6f-88a2-aff30001fa10 tempest-ProjectReaderTests-496383587 None] Created volume successfully. Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Creating offline snapshot 246d68bd-b309-4fe7-ac3b-852603ed151d of volume 46fa2e0e-d657-4881-862e-33effea29d16 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2424391e-61db-456f-a1a1-cc4e45a88dbf]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:31:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:40 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16 Jul 06 10:31:40 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:40 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16" returned: 0 in 0.769s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:40 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d 1G Jul 06 10:31:40 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:41 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d 1G" returned: 0 in 0.783s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fa2e0e-d657-4881-862e-33effea29d16 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:41 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fa2e0e-d657-4881-862e-33effea29d16 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d Jul 06 10:31:41 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:42 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46fa2e0e-d657-4881-862e-33effea29d16 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d" returned: 0 in 0.779s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:42 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d is being set with open permissions: ugo+rw Jul 06 10:31:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:42 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d Jul 06 10:31:42 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:42 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.246d68bd-b309-4fe7-ac3b-852603ed151d" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:42 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.info Jul 06 10:31:42 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:43 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.info" returned: 0 in 0.654s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:43 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.info is being set with open permissions: ugo+rw Jul 06 10:31:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:43 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.info Jul 06 10:31:43 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:44 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-46fa2e0e-d657-4881-862e-33effea29d16.info" returned: 0 in 0.625s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.378s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-037f123f-1b30-4fb8-99bf-d5799f4a10c8 tempest-ProjectReaderTests-496383587 None] Create snapshot completed successfully Jul 06 10:31:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e2495bf2-57cb-4d05-bc05-c49e0d473399 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-246d68bd-b309-4fe7-ac3b-852603ed151d-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:31:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e2495bf2-57cb-4d05-bc05-c49e0d473399 tempest-ProjectReaderTests-496383587 None] Lock "cinder-246d68bd-b309-4fe7-ac3b-852603ed151d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:31:45 devstack cinder-volume[86456]: INFO cinder.message.api [None req-e2495bf2-57cb-4d05-bc05-c49e0d473399 tempest-ProjectReaderTests-496383587 None] Creating message record for request_id = req-e2495bf2-57cb-4d05-bc05-c49e0d473399 Jul 06 10:31:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e2495bf2-57cb-4d05-bc05-c49e0d473399 tempest-ProjectReaderTests-496383587 None] Lock "cinder-246d68bd-b309-4fe7-ac3b-852603ed151d-delete_snapshot" released by "delete_snapshot" :: held 0.047s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server [None req-e2495bf2-57cb-4d05-bc05-c49e0d473399 tempest-ProjectReaderTests-496383587 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server return f(*a, **k) Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server raise self.value Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Jul 06 10:31:45 devstack cinder-volume[86456]: ERROR oslo_messaging.rpc.server Jul 06 10:31:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:31:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:31:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:31:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:31:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:31:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:31:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:31:59 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:31:59 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:31:59 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 06 10:31:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.609s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:31:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:31:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:31:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:31:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:31:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=65,cinder:SELECT=53,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:31:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=44,cinder:INSERT=17,cinder:UPDATE=63,cinder:DELETE=4 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:32:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:32:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:32:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:32:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:32:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:32:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:32:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:32:59 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:32:59 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:32:59 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 06 10:32:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.642s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:32:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:32:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:32:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:32:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:33:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:33:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:33:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:33:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:33:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:33:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:33:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:33:59 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:33:59 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:33:59 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 06 10:33:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.638s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:33:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:33:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:33:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:33:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:33:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:33:59 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=1 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (d5d30084-a91b-40b0-bdc3-1c80cfecaa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5e172e-a782-4e56-86d4-6b252cad9450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5e172e-a782-4e56-86d4-6b252cad9450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929037786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:34:54Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ba53eb-492f-4fd7-8bc9-a76ad5f4002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ba53eb-492f-4fd7-8bc9-a76ad5f4002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d2e98e-e72e-464f-9c70-ca70b464b3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d2e98e-e72e-464f-9c70-ca70b464b3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d', 'volume_name': 'volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473030ee-3734-4ec7-b6bc-54352a4f750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473030ee-3734-4ec7-b6bc-54352a4f750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3251faa-230d-4454-97db-5eceecda2b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:34:54 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Volume 4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d', 'volume_size': 1} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929037786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:34:54Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Creating volume 4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:34:54 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:34:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:54 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d 1073741824 Jul 06 10:34:54 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:34:55 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 06 10:34:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d 1073741824" returned: 0 in 0.818s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:34:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:55 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d Jul 06 10:34:55 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:34:56 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" returned: 0 in 0.644s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3251faa-230d-4454-97db-5eceecda2b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f93827-406e-453f-9abf-ac73964150eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:34:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Volume volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d (4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d): created successfully Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f93827-406e-453f-9abf-ac73964150eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (d5d30084-a91b-40b0-bdc3-1c80cfecaa5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:34:56 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-11ef7058-b261-4374-9024-d404b7916654 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Creating offline snapshot bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 of volume 4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3ef53-f489-4a17-bd4e-e7a9ca37fdd5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:34:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:56 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d Jul 06 10:34:56 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:34:57 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 06 10:34:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" returned: 0 in 0.759s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:34:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:57 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 1G Jul 06 10:34:57 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:34:58 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 1G" returned: 0 in 0.769s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:58 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 Jul 06 10:34:58 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:34:58 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" returned: 0 in 0.649s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:34:58 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 is being set with open permissions: ugo+rw Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:58 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 Jul 06 10:34:58 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:34:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:59 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:34:59 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:34:59 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 06 10:34:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:34:59 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 06 10:34:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:34:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.610s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:34:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:34:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:34:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:34:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:34:59 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.info Jul 06 10:34:59 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:00 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.info" returned: 0 in 0.661s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:00 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.info is being set with open permissions: ugo+rw Jul 06 10:35:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:00 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.info Jul 06 10:35:00 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:00 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.info" returned: 0 in 0.657s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.248s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-60a7b6b6-cca4-4a9d-b461-d1c86221f4a0 tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-bd09b14b-7a6b-4f7d-925f-37b31c9d5b72-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Lock "cinder-bd09b14b-7a6b-4f7d-925f-37b31c9d5b72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (5ae2395d-0586-4409-bdc7-e778cc1ab1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c715567e-337e-4876-9a2c-d2765462fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 of volume 4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c715567e-337e-4876-9a2c-d2765462fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078156143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d6ff8b-bede-4a97-9517-4893d05db970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:02Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306302d4-b570-4b7d-841e-fab00486a051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306302d4-b570-4b7d-841e-fab00486a051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f654d-21a0-4f84-86b6-899e67c1a5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6f654d-21a0-4f84-86b6-899e67c1a5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d6ff8b-bede-4a97-9517-4893d05db970', 'volume_name': 'volume-36d6ff8b-bede-4a97-9517-4893d05db970', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45714ea9-a76f-4282-b8a4-efc891a3c00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45714ea9-a76f-4282-b8a4-efc891a3c00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5747373-2c2b-4a6e-b9fb-234344fe359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:02 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Volume 36d6ff8b-bede-4a97-9517-4893d05db970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d6ff8b-bede-4a97-9517-4893d05db970', 'volume_size': 1} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078156143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d6ff8b-bede-4a97-9517-4893d05db970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:02Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Creating volume 36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:02 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bda76c-2eee-4a0b-854b-fbb90993ef6e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:02 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 1073741824 Jul 06 10:35:02 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:02 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 Jul 06 10:35:02 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:03 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" returned: 0 in 0.816s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e21cbc-c905-4426-a62a-fb593d17f9c6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:03 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 1073741824" returned: 0 in 0.870s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:03 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 Jul 06 10:35:03 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:03 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d Jul 06 10:35:03 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:03 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970" returned: 0 in 0.667s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5747373-2c2b-4a6e-b9fb-234344fe359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d6ff8b-bede-4a97-9517-4893d05db970', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dee69b-bdcc-4d35-9d90-4f1504ee8515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:03 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Volume volume-36d6ff8b-bede-4a97-9517-4893d05db970 (36d6ff8b-bede-4a97-9517-4893d05db970): created successfully Jul 06 10:35:03 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4dee69b-bdcc-4d35-9d90-4f1504ee8515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (5ae2395d-0586-4409-bdc7-e778cc1ab1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" returned: 0 in 0.782s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5aa9cc18-76f1-49eb-acd1-71ad9a24b9d0 tempest-ProjectReaderTests-496383587 None] Created volume successfully. Jul 06 10:35:03 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 Jul 06 10:35:03 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Creating offline snapshot dc93891e-f579-4077-b212-8c80b02a6454 of volume 36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:35:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82ca751-2a7b-4e53-99d8-8f900c0fec3a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:04 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 Jul 06 10:35:04 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:04 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" returned: 0 in 0.763s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:04 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72 Jul 06 10:35:04 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:05 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970" returned: 0 in 0.786s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:05 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 1G Jul 06 10:35:05 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:05 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d.bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" returned: 0 in 0.676s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-bd09b14b-7a6b-4f7d-925f-37b31c9d5b72" released by "_delete_snapshot" :: held 3.209s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" released by "delete_snapshot" :: held 3.274s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:05 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Created reservations ['bf7a1e5d-6d26-40df-bfa0-091870be6250', '48a27ba3-4c31-4520-9bfd-4703e487dec4', '3e73a702-0a08-4d97-a0ee-7b264d697521', '7a4d2fdb-6f26-4ce3-afe1-9075019c5404'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:35:05 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-53099d04-d21c-4159-860a-3d4b888f8d3d tempest-ProjectMemberTests-97035211 None] Lock "cinder-bd09b14b-7a6b-4f7d-925f-37b31c9d5b72-delete_snapshot" released by "delete_snapshot" :: held 3.424s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:06 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 1G" returned: 0 in 0.820s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d6ff8b-bede-4a97-9517-4893d05db970 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:06 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d6ff8b-bede-4a97-9517-4893d05db970 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 Jul 06 10:35:06 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Lock "cinder-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e53d9-9478-4937-adca-232d747f42c7]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:06 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d Jul 06 10:35:06 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:06 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36d6ff8b-bede-4a97-9517-4893d05db970 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454" returned: 0 in 0.723s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:06 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 is being set with open permissions: ugo+rw Jul 06 10:35:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:06 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 Jul 06 10:35:06 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:07 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:07 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d Jul 06 10:35:07 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:07 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454" returned: 0 in 0.715s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:07 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.info Jul 06 10:35:07 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:07 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" returned: 0 in 0.654s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d" released by "delete_volume" :: held 1.486s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Created reservations ['6e58a537-aec9-45d5-b3d8-d060ed66d926', 'd290c139-2611-42d9-957b-2f7c55a35919', '89a4dc8a-1c0d-4515-8533-caf091f4bf9a', '99f4fcee-21bd-4a12-a98c-0c76865f3a8c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:08 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:08 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:08 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.info" returned: 0 in 0.686s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:08 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.info is being set with open permissions: ugo+rw Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:08 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.info Jul 06 10:35:08 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:08 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-30ea3de3-9c84-45fe-9004-4a64c8517f40 tempest-ProjectMemberTests-97035211 None] Lock "cinder-4ec3d7d8-e5b4-45c4-bbe9-f7ec0d766f8d-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:08 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.info" returned: 0 in 0.726s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.555s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-781a06bf-1711-4599-9f00-efc34a657f5c tempest-ProjectReaderTests-496383587 None] Create snapshot completed successfully Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (810b4507-e124-4bca-85f2-5df76f34643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc1af92-5949-4b57-a105-acefccbc9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc1af92-5949-4b57-a105-acefccbc9eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691852657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f80d5-db42-45ce-a9fa-6fac1d9fca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:09Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed580ea-5410-4c0b-b14d-da6a268f2145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed580ea-5410-4c0b-b14d-da6a268f2145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956a5058-b91f-44c6-8596-51e997597e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956a5058-b91f-44c6-8596-51e997597e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936f80d5-db42-45ce-a9fa-6fac1d9fca5c', 'volume_name': 'volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76086b4f-0148-4fa9-8daf-4a90a7c7db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76086b4f-0148-4fa9-8daf-4a90a7c7db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47313ed5-6a51-4a46-8d74-fb0f6699f810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:09 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Volume 936f80d5-db42-45ce-a9fa-6fac1d9fca5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c', 'volume_size': 1} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691852657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f80d5-db42-45ce-a9fa-6fac1d9fca5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:09Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Creating volume 936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:09 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:09 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c 1073741824 Jul 06 10:35:09 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-dc93891e-f579-4077-b212-8c80b02a6454-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Lock "cinder-dc93891e-f579-4077-b212-8c80b02a6454-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-36d6ff8b-bede-4a97-9517-4893d05db970" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-36d6ff8b-bede-4a97-9517-4893d05db970" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-dc93891e-f579-4077-b212-8c80b02a6454" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-dc93891e-f579-4077-b212-8c80b02a6454" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Deleting offline snapshot dc93891e-f579-4077-b212-8c80b02a6454 of volume 36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] snapshot_file for this snap is: volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898156a-ccc3-4bd0-a034-8ce9535c235e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:09 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:09 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 Jul 06 10:35:09 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:10 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c 1073741824" returned: 0 in 0.870s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:10 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c Jul 06 10:35:10 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:10 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454" returned: 0 in 0.798s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36d6ff8b-bede-4a97-9517-4893d05db970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72aed9b-a495-4a2d-b6c9-2084ca23b109]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:10 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 Jul 06 10:35:10 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:10 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47313ed5-6a51-4a46-8d74-fb0f6699f810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ddd4d6-da1c-47bb-948e-af3f4dac4c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:10 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Volume volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c (936f80d5-db42-45ce-a9fa-6fac1d9fca5c): created successfully Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ddd4d6-da1c-47bb-948e-af3f4dac4c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:10 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (810b4507-e124-4bca-85f2-5df76f34643f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:10 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c9b9983b-d702-4cf2-b248-f8ea47d6cade tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:35:11 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970" returned: 0 in 0.810s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:11 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 Jul 06 10:35:11 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:11 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Creating offline snapshot be672619-e9fb-4232-829f-42940a11f22c of volume 936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:35:11 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d776d9cc-c414-4108-83ed-07399497a7af]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:11 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:11 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c Jul 06 10:35:11 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:12 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454" returned: 0 in 0.790s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:12 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454 Jul 06 10:35:12 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:12 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" returned: 0 in 0.812s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:12 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c 1G Jul 06 10:35:12 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:12 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970.dc93891e-f579-4077-b212-8c80b02a6454" returned: 0 in 0.700s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-dc93891e-f579-4077-b212-8c80b02a6454" released by "_delete_snapshot" :: held 3.197s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-36d6ff8b-bede-4a97-9517-4893d05db970" released by "delete_snapshot" :: held 3.222s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:12 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Created reservations ['d28e9357-b386-4219-9d0d-94c758bece67', '18ac7775-e8c5-4206-aedc-ae83fb0242ae', '65f6211f-b0a6-4553-a076-f1cd8671279e', '43ef2ba2-b502-4eec-99aa-8682bd277f5d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:13 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Delete snapshot completed successfully. Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e3537d2f-383e-474b-90ff-c2a82eed0014 tempest-ProjectReaderTests-496383587 None] Lock "cinder-dc93891e-f579-4077-b212-8c80b02a6454-delete_snapshot" released by "delete_snapshot" :: held 3.391s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:13 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c 1G" returned: 0 in 0.889s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:13 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c Jul 06 10:35:13 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:13 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c" returned: 0 in 0.692s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:13 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c is being set with open permissions: ugo+rw Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-36d6ff8b-bede-4a97-9517-4893d05db970-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:13 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c Jul 06 10:35:13 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Lock "cinder-36d6ff8b-bede-4a97-9517-4893d05db970-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-36d6ff8b-bede-4a97-9517-4893d05db970" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-36d6ff8b-bede-4a97-9517-4893d05db970" acquired by "delete_volume" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874230c-8875-4347-a6d7-ab5ff38cc2c3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:13 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:14 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 Jul 06 10:35:14 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:14 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c" returned: 0 in 0.684s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:14 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.info Jul 06 10:35:14 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:14 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970" returned: 0 in 0.812s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:14 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:14 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970 Jul 06 10:35:14 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:15 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.info" returned: 0 in 0.665s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:15 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.info is being set with open permissions: ugo+rw Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:15 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.info Jul 06 10:35:15 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:15 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-36d6ff8b-bede-4a97-9517-4893d05db970" returned: 0 in 0.656s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-36d6ff8b-bede-4a97-9517-4893d05db970" released by "delete_volume" :: held 1.531s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Created reservations ['06998bfd-e82a-4f53-8449-d90d00ab606d', '8ade33ad-9e82-4dfe-b323-43aced45e242', '1f373b14-b8ba-462f-bfc8-5808e42660b3', 'd967e536-5e2a-48bc-88cc-22f713487128'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:15 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:15 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:15 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.info" returned: 0 in 0.660s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:15 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.485s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:15 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-c322202c-6e4e-48c3-a7cf-dd35838c5b4b tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:35:16 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.694s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:16 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Deleted volume successfully. Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9813b3b3-4190-4235-b6af-cf5b3f70b3e8 tempest-ProjectReaderTests-496383587 None] Lock "cinder-36d6ff8b-bede-4a97-9517-4893d05db970-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (f251b42e-c531-4e85-a510-0c1afb55f243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d7dc02-c2c5-46e3-a46b-61a9170f3557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d7dc02-c2c5-46e3-a46b-61a9170f3557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582975636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a40e12-834b-4749-a782-1e7ac884e7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:17Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6579bbd-083a-49aa-868d-39333d27f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6579bbd-083a-49aa-868d-39333d27f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c5e8b7-695b-47ca-8be0-c12b4a407d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c5e8b7-695b-47ca-8be0-c12b4a407d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a40e12-834b-4749-a782-1e7ac884e7b2', 'volume_name': 'volume-85a40e12-834b-4749-a782-1e7ac884e7b2', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7010fda9-e78f-4874-b924-abfcd870070b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7010fda9-e78f-4874-b924-abfcd870070b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b9c9b6-6077-4d34-a353-941c4f569243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:16 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Volume 85a40e12-834b-4749-a782-1e7ac884e7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a40e12-834b-4749-a782-1e7ac884e7b2', 'volume_size': 1} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582975636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a40e12-834b-4749-a782-1e7ac884e7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:17Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Creating volume 85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:16 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-be672619-e9fb-4232-829f-42940a11f22c-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:16 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 1073741824 Jul 06 10:35:16 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Lock "cinder-be672619-e9fb-4232-829f-42940a11f22c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-be672619-e9fb-4232-829f-42940a11f22c" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-be672619-e9fb-4232-829f-42940a11f22c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot be672619-e9fb-4232-829f-42940a11f22c of volume 936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4348ef-d6c4-4ee8-a609-5b13433dea5d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:16 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:16 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c Jul 06 10:35:16 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:17 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 1073741824" returned: 0 in 0.872s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:17 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:17 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 Jul 06 10:35:17 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c" returned: 0 in 0.829s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:17 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:35:17 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb1d9b9-1283-444b-a9eb-31c27fc711ac]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:17 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:17 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c Jul 06 10:35:17 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:18 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2" returned: 0 in 0.675s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b9c9b6-6077-4d34-a353-941c4f569243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a40e12-834b-4749-a782-1e7ac884e7b2', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff764ca-ecf4-4b3a-90e9-9cc600dc887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:18 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Volume volume-85a40e12-834b-4749-a782-1e7ac884e7b2 (85a40e12-834b-4749-a782-1e7ac884e7b2): created successfully Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff764ca-ecf4-4b3a-90e9-9cc600dc887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (f251b42e-c531-4e85-a510-0c1afb55f243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:18 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6057ffd4-81ff-4dc9-a82b-b2eb5b632074 tempest-ProjectReaderTests-496383587 None] Created volume successfully. Jul 06 10:35:18 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" returned: 0 in 0.770s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:18 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c Jul 06 10:35:18 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Creating offline snapshot 1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 of volume 85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ef28cb-9c41-4dd1-b532-b1b065bdc42a]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:18 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:18 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 Jul 06 10:35:18 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:19 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c" returned: 0 in 0.799s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:19 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c Jul 06 10:35:19 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:19 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2" returned: 0 in 0.804s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:19 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 1G Jul 06 10:35:19 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:19 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c.be672619-e9fb-4232-829f-42940a11f22c" returned: 0 in 0.648s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-be672619-e9fb-4232-829f-42940a11f22c" released by "_delete_snapshot" :: held 3.148s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" released by "delete_snapshot" :: held 3.175s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Created reservations ['c36aeeb7-122e-4e2f-a88f-7d1e2f177389', '9b1c699e-9506-4f89-95c5-3f12b2a76c4f', '8ce20ae8-6488-40f0-aac2-5f0365f794d8', '43e70f83-593f-4ef2-a9d0-210bf09fcea5'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:19 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:35:19 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-24cae14a-0a0c-44b8-bdda-9ac0c6a5d21b tempest-ProjectMemberTests-97035211 None] Lock "cinder-be672619-e9fb-4232-829f-42940a11f22c-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:20 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 1G" returned: 0 in 0.797s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:20 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a40e12-834b-4749-a782-1e7ac884e7b2 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:20 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a40e12-834b-4749-a782-1e7ac884e7b2 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 Jul 06 10:35:20 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-936f80d5-db42-45ce-a9fa-6fac1d9fca5c-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:20 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Lock "cinder-936f80d5-db42-45ce-a9fa-6fac1d9fca5c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[9960640e-e161-405a-8a85-ee2b578a2a0e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:21 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c Jul 06 10:35:21 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:21 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85a40e12-834b-4749-a782-1e7ac884e7b2 -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" returned: 0 in 0.729s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:21 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 is being set with open permissions: ugo+rw Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:21 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 Jul 06 10:35:21 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:21 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" returned: 0 in 0.769s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:21 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" returned: 0 in 0.668s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:21 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c Jul 06 10:35:21 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:21 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:21 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.info Jul 06 10:35:21 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:22 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" returned: 0 in 0.644s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-936f80d5-db42-45ce-a9fa-6fac1d9fca5c" released by "delete_volume" :: held 1.477s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Created reservations ['fc0193f8-7bdd-4497-bbec-316a5edb62fe', '311eae34-3788-4cc1-aa88-0a83995f14a1', 'c716414f-8c67-4c1d-a7d6-9cc9ba96cb9e', '8aed843f-bb0e-42e3-adbc-987628dbb77d'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:22 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.info" returned: 0 in 0.712s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:22 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.info is being set with open permissions: ugo+rw Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:22 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.info Jul 06 10:35:22 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:22 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:22 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:22 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:23 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.info" returned: 0 in 0.699s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.499s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:23 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:35:23 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-56b00dcf-6565-4a87-8ed1-00c73c2d953d tempest-ProjectReaderTests-496383587 None] Create snapshot completed successfully Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6ec6080f-d39e-4367-b550-a202377701dc tempest-ProjectMemberTests-97035211 None] Lock "cinder-936f80d5-db42-45ce-a9fa-6fac1d9fca5c-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (4647c5d2-ec4a-412b-a651-28a4e25da510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a183b87-38b8-4eb6-9969-a10f5d8cd8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a183b87-38b8-4eb6-9969-a10f5d8cd8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111695068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d37773-5455-4b93-b6ec-15b78653198b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:24Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376453bd-6709-45fb-9e5f-33548c05e721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (376453bd-6709-45fb-9e5f-33548c05e721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5624d0-ca9e-433d-b26e-89d6ed5e332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5624d0-ca9e-433d-b26e-89d6ed5e332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d37773-5455-4b93-b6ec-15b78653198b', 'volume_name': 'volume-85d37773-5455-4b93-b6ec-15b78653198b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121b9368-e043-4cda-9f8b-5418d2d3752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121b9368-e043-4cda-9f8b-5418d2d3752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afea608-e1d9-4fba-8cbc-67567539c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Volume 85d37773-5455-4b93-b6ec-15b78653198b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d37773-5455-4b93-b6ec-15b78653198b', 'volume_size': 1} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111695068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d37773-5455-4b93-b6ec-15b78653198b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:24Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Creating volume 85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:23 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:23 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b 1073741824 Jul 06 10:35:23 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-1b74f62b-3ad6-43ff-94b3-f2f1ed60a295-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Lock "cinder-1b74f62b-3ad6-43ff-94b3-f2f1ed60a295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-85a40e12-834b-4749-a782-1e7ac884e7b2" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-85a40e12-834b-4749-a782-1e7ac884e7b2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Deleting offline snapshot 1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 of volume 85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] snapshot_file for this snap is: volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fb13b9-6962-46cb-925b-e8d7518417f5]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:24 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 Jul 06 10:35:24 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:24 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b 1073741824" returned: 0 in 0.871s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:24 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b Jul 06 10:35:24 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:24 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" returned: 0 in 0.816s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85a40e12-834b-4749-a782-1e7ac884e7b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[55993594-183d-4851-8ff6-95a9397fc94e]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:25 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 Jul 06 10:35:25 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:25 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b" returned: 0 in 0.654s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afea608-e1d9-4fba-8cbc-67567539c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d37773-5455-4b93-b6ec-15b78653198b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d433662f-fd1f-44f4-9cf1-8bc7083c013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:25 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Volume volume-85d37773-5455-4b93-b6ec-15b78653198b (85d37773-5455-4b93-b6ec-15b78653198b): created successfully Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d433662f-fd1f-44f4-9cf1-8bc7083c013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (4647c5d2-ec4a-412b-a651-28a4e25da510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:25 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-27df4bbf-50f4-42eb-a67d-ba2185f1991e tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:35:25 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2" returned: 0 in 0.811s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:25 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 Jul 06 10:35:25 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Creating offline snapshot 3348e1bc-068f-41a2-a684-ab2b63c56226 of volume 85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ff1b82-22fe-49f9-b584-43f10d4edafb]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:26 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b Jul 06 10:35:26 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:26 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" returned: 0 in 0.773s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:26 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295 Jul 06 10:35:26 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:26 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b" returned: 0 in 0.798s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:26 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 1G Jul 06 10:35:26 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:27 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2.1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" returned: 0 in 0.710s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-1b74f62b-3ad6-43ff-94b3-f2f1ed60a295" released by "_delete_snapshot" :: held 3.203s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-85a40e12-834b-4749-a782-1e7ac884e7b2" released by "delete_snapshot" :: held 3.229s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:27 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Created reservations ['8f02713c-1e93-483a-ad5a-a16d5ce81618', '26e189b9-334c-41d3-ac06-e006303eecf6', '28708bf6-65db-402e-a22b-70adbc6cd2c8', '9b1d1395-a2ac-4082-90ee-31f4928a70dc'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:27 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Delete snapshot completed successfully. Jul 06 10:35:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-386b3d23-0f8e-46b3-9775-6bcb23be418b tempest-ProjectReaderTests-496383587 None] Lock "cinder-1b74f62b-3ad6-43ff-94b3-f2f1ed60a295-delete_snapshot" released by "delete_snapshot" :: held 3.380s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:27 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 1G" returned: 0 in 0.855s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d37773-5455-4b93-b6ec-15b78653198b -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:27 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d37773-5455-4b93-b6ec-15b78653198b -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 Jul 06 10:35:27 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:28 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85d37773-5455-4b93-b6ec-15b78653198b -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226" returned: 0 in 0.661s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:28 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 is being set with open permissions: ugo+rw Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:28 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 Jul 06 10:35:28 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-85a40e12-834b-4749-a782-1e7ac884e7b2-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Lock "cinder-85a40e12-834b-4749-a782-1e7ac884e7b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-85a40e12-834b-4749-a782-1e7ac884e7b2" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-85a40e12-834b-4749-a782-1e7ac884e7b2" acquired by "delete_volume" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2752b33-bd58-4365-8b53-571fcca2fda6]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:28 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 Jul 06 10:35:28 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:28 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226" returned: 0 in 0.707s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:29 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.info Jul 06 10:35:29 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:29 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2" returned: 0 in 0.802s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:29 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2 Jul 06 10:35:29 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:29 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.info" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:29 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.info is being set with open permissions: ugo+rw Jul 06 10:35:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:29 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.info Jul 06 10:35:29 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:29 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85a40e12-834b-4749-a782-1e7ac884e7b2" returned: 0 in 0.681s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:29 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-85a40e12-834b-4749-a782-1e7ac884e7b2" released by "delete_volume" :: held 1.543s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Created reservations ['788e47b2-8ca7-4ccc-a9aa-31229d427cbe', '2597327d-674e-498d-947c-73a50043e4e2', 'ad10b905-59b2-49a4-9610-93e22a8adc2f', '9041d8d2-88ad-4dbe-b5dc-715b12463c2c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:30 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:30 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:30 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.info" returned: 0 in 0.679s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.459s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-f7967fec-0220-49c5-8fe9-2fcbcdc3c278 tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:35:30 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.660s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:30 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Deleted volume successfully. Jul 06 10:35:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-a3b42070-287e-4646-805f-89dd98eb33ab tempest-ProjectReaderTests-496383587 None] Lock "cinder-85a40e12-834b-4749-a782-1e7ac884e7b2-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (2028a4b0-1fc1-47c1-919c-c14c613eb6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6498ec09-5fff-4d70-92dc-985c02c88a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6498ec09-5fff-4d70-92dc-985c02c88a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1868911559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edef8b9a-5ca0-4f28-b29a-ed321b30134a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:31Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9132502-0c46-4bf4-a62e-d9595684d122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9132502-0c46-4bf4-a62e-d9595684d122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ea623b-7a5c-4579-b99c-7d0492bac846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ea623b-7a5c-4579-b99c-7d0492bac846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edef8b9a-5ca0-4f28-b29a-ed321b30134a', 'volume_name': 'volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff8f388-e1ae-4f70-a6a3-3581f8361e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff8f388-e1ae-4f70-a6a3-3581f8361e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942dea9-c630-46f4-9989-1e40147394c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:31 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Volume edef8b9a-5ca0-4f28-b29a-ed321b30134a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a', 'volume_size': 1} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1868911559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edef8b9a-5ca0-4f28-b29a-ed321b30134a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1111e2350d9417784caf2ceb646b666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:31Z,use_quota=True,user_id='80ce87ebf2d04c94baec072c741c3719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Creating volume edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:31 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:31 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a 1073741824 Jul 06 10:35:31 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-3348e1bc-068f-41a2-a684-ab2b63c56226-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Lock "cinder-3348e1bc-068f-41a2-a684-ab2b63c56226-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-85d37773-5455-4b93-b6ec-15b78653198b" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-85d37773-5455-4b93-b6ec-15b78653198b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-3348e1bc-068f-41a2-a684-ab2b63c56226" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-3348e1bc-068f-41a2-a684-ab2b63c56226" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot 3348e1bc-068f-41a2-a684-ab2b63c56226 of volume 85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf9e091-f9b0-4041-b7ca-d0e4702e24a4]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:31 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 Jul 06 10:35:31 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:32 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a 1073741824" returned: 0 in 0.890s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:32 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226" returned: 0 in 0.797s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85d37773-5455-4b93-b6ec-15b78653198b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39be43e-4c59-4a07-8cc2-81138660ce2b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:32 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a Jul 06 10:35:32 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:32 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b Jul 06 10:35:32 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:32 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a" returned: 0 in 0.651s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1942dea9-c630-46f4-9989-1e40147394c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2b9fec-a9eb-4f22-a03e-063095019545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:32 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Volume volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a (edef8b9a-5ca0-4f28-b29a-ed321b30134a): created successfully Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2b9fec-a9eb-4f22-a03e-063095019545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Flow 'volume_create_manager' (2028a4b0-1fc1-47c1-919c-c14c613eb6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b4e941af-c8b6-46de-a782-e49552ccb47c tempest-ProjectReaderTests-496383587 None] Created volume successfully. Jul 06 10:35:32 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b" returned: 0 in 0.795s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:32 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 Jul 06 10:35:32 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:33 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Creating offline snapshot 65d5e75d-2326-4b2a-a2e1-7c46444405f5 of volume edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:35:33 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a590e9-b0e6-4000-993c-b92196e467e3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:33 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a Jul 06 10:35:33 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:33 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:33 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226 Jul 06 10:35:33 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:34 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a" returned: 0 in 0.784s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:34 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 1G Jul 06 10:35:34 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:34 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b.3348e1bc-068f-41a2-a684-ab2b63c56226" returned: 0 in 0.678s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-3348e1bc-068f-41a2-a684-ab2b63c56226" released by "_delete_snapshot" :: held 3.161s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-85d37773-5455-4b93-b6ec-15b78653198b" released by "delete_snapshot" :: held 3.184s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Created reservations ['09ae47e6-4e7a-495c-80b4-615481b94094', '76fec844-c02d-412c-92a6-03c051366dde', '2c70b688-32b5-41e9-b4cc-92b3343c477f', 'a2eabad9-2d64-4c8e-80cf-e9940852fa52'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-0c22f85e-7811-43ed-8291-eac3dcf5b87a tempest-ProjectMemberTests-97035211 None] Lock "cinder-3348e1bc-068f-41a2-a684-ab2b63c56226-delete_snapshot" released by "delete_snapshot" :: held 3.332s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:34 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 1G" returned: 0 in 0.785s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:34 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 Jul 06 10:35:34 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-85d37773-5455-4b93-b6ec-15b78653198b-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Lock "cinder-85d37773-5455-4b93-b6ec-15b78653198b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-85d37773-5455-4b93-b6ec-15b78653198b" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-85d37773-5455-4b93-b6ec-15b78653198b" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[88951325-c6e5-4e52-998c-a5889ab8fd7b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:35 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5" returned: 0 in 0.730s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:35 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 is being set with open permissions: ugo+rw Jul 06 10:35:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:35 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 Jul 06 10:35:35 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:35 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b Jul 06 10:35:35 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:36 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5" returned: 0 in 0.658s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:36 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.info Jul 06 10:35:36 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:36 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b" returned: 0 in 0.800s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:36 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b Jul 06 10:35:36 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:36 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.info" returned: 0 in 0.673s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:36 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.info is being set with open permissions: ugo+rw Jul 06 10:35:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:36 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-85d37773-5455-4b93-b6ec-15b78653198b" returned: 0 in 0.644s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:37 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.info Jul 06 10:35:37 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-85d37773-5455-4b93-b6ec-15b78653198b" released by "delete_volume" :: held 1.503s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Created reservations ['292806dc-ac5b-4688-97b0-f86237e5d326', 'ebfdcdb6-1917-48c4-85c5-eb0c787d4084', '34684dbd-d6f1-4ada-92f2-19aee076843a', 'a877b420-a4cf-41ef-8aba-c65720162c3c'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:37 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:37 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:37 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.info" returned: 0 in 0.639s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.364s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-35e7f887-e785-4b8d-b19c-9f658da2e36b tempest-ProjectReaderTests-496383587 None] Create snapshot completed successfully Jul 06 10:35:37 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.685s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:37 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:35:37 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-3743cd4a-383b-4083-98f7-9993f3970cc8 tempest-ProjectMemberTests-97035211 None] Lock "cinder-85d37773-5455-4b93-b6ec-15b78653198b-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (b56aeef7-e798-4a15-8466-954aa8755a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ab4dc3-adac-475a-8a10-e4047b0ca646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ab4dc3-adac-475a-8a10-e4047b0ca646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614905277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eadbbde-ca00-457d-9594-67ec3d21a68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:38Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75903918-9955-4cf0-8791-66b12b2c3661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75903918-9955-4cf0-8791-66b12b2c3661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499bb68a-867e-4a9b-8281-461c6245b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499bb68a-867e-4a9b-8281-461c6245b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eadbbde-ca00-457d-9594-67ec3d21a68a', 'volume_name': 'volume-2eadbbde-ca00-457d-9594-67ec3d21a68a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a6f84-18e8-41bc-ad95-6dedec59fefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12a6f84-18e8-41bc-ad95-6dedec59fefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05479250-822e-472b-8334-084444d865fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:38 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Volume 2eadbbde-ca00-457d-9594-67ec3d21a68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eadbbde-ca00-457d-9594-67ec3d21a68a', 'volume_size': 1} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614905277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eadbbde-ca00-457d-9594-67ec3d21a68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:38Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Creating volume 2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:38 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:38 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a 1073741824 Jul 06 10:35:38 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-65d5e75d-2326-4b2a-a2e1-7c46444405f5-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Lock "cinder-65d5e75d-2326-4b2a-a2e1-7c46444405f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-edef8b9a-5ca0-4f28-b29a-ed321b30134a" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-edef8b9a-5ca0-4f28-b29a-ed321b30134a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-65d5e75d-2326-4b2a-a2e1-7c46444405f5" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-65d5e75d-2326-4b2a-a2e1-7c46444405f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Deleting offline snapshot 65d5e75d-2326-4b2a-a2e1-7c46444405f5 of volume edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] snapshot_file for this snap is: volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f85bd-91de-4f2a-812f-07c55855609d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:38 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 Jul 06 10:35:38 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:39 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a 1073741824" returned: 0 in 0.897s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:39 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a Jul 06 10:35:39 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:39 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5" returned: 0 in 0.861s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc259a6a-c4f2-41a2-8d7a-8f677c1896ef]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:39 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a Jul 06 10:35:39 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:39 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a" returned: 0 in 0.722s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05479250-822e-472b-8334-084444d865fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eadbbde-ca00-457d-9594-67ec3d21a68a', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f44c66e-0cbc-4ad6-99f6-fcb6fbffb325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:39 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Volume volume-2eadbbde-ca00-457d-9594-67ec3d21a68a (2eadbbde-ca00-457d-9594-67ec3d21a68a): created successfully Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f44c66e-0cbc-4ad6-99f6-fcb6fbffb325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:39 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (b56aeef7-e798-4a15-8466-954aa8755a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:39 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5ee51199-41e3-4c61-9810-595265456b58 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:35:40 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a" returned: 0 in 0.777s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:40 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 Jul 06 10:35:40 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:40 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Creating offline snapshot 541046fd-1260-4452-969d-daff11441e78 of volume 2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:35:40 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[299241d7-ed31-4ed4-b4d4-dc2b95ae976d]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:40 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a Jul 06 10:35:40 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:41 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5" returned: 0 in 0.835s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:41 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5 Jul 06 10:35:41 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:41 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a" returned: 0 in 0.813s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:41 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 1G Jul 06 10:35:41 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:41 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a.65d5e75d-2326-4b2a-a2e1-7c46444405f5" returned: 0 in 0.647s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-65d5e75d-2326-4b2a-a2e1-7c46444405f5" released by "_delete_snapshot" :: held 3.228s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-edef8b9a-5ca0-4f28-b29a-ed321b30134a" released by "delete_snapshot" :: held 3.253s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Created reservations ['9ce3f0a9-63ca-4721-a220-f6d5b2ba7e36', '7a7b2ae2-be5c-4ec1-a9c5-1c477ac36f5b', '63128370-a0c9-443b-8400-b0fb33346598', '8bbb3ec2-e40a-459e-8428-73b5db8be8c3'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Delete snapshot completed successfully. Jul 06 10:35:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-255927af-883b-4a8f-934d-20de75544942 tempest-ProjectReaderTests-496383587 None] Lock "cinder-65d5e75d-2326-4b2a-a2e1-7c46444405f5-delete_snapshot" released by "delete_snapshot" :: held 3.410s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:42 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 1G" returned: 0 in 0.811s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eadbbde-ca00-457d-9594-67ec3d21a68a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:42 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eadbbde-ca00-457d-9594-67ec3d21a68a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 Jul 06 10:35:42 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:42 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eadbbde-ca00-457d-9594-67ec3d21a68a -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78" returned: 0 in 0.670s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:42 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 is being set with open permissions: ugo+rw Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-edef8b9a-5ca0-4f28-b29a-ed321b30134a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:42 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 Jul 06 10:35:42 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Lock "cinder-edef8b9a-5ca0-4f28-b29a-ed321b30134a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Acquiring lock "cinder-quobyte-edef8b9a-5ca0-4f28-b29a-ed321b30134a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-edef8b9a-5ca0-4f28-b29a-ed321b30134a" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25da8b5-ecff-4e68-9d41-51a01dca3b4b]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:42 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:42 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a Jul 06 10:35:42 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:43 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78" returned: 0 in 0.716s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:43 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.info Jul 06 10:35:43 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:43 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a" returned: 0 in 0.747s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:43 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:43 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a Jul 06 10:35:43 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:44 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.info" returned: 0 in 0.676s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:44 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.info is being set with open permissions: ugo+rw Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:44 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.info Jul 06 10:35:44 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:44 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-edef8b9a-5ca0-4f28-b29a-ed321b30134a" returned: 0 in 0.684s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Lock "cinder-quobyte-edef8b9a-5ca0-4f28-b29a-ed321b30134a" released by "delete_volume" :: held 1.482s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Created reservations ['75b970ea-efff-484b-b6c8-f080029510ec', 'c66525db-74fa-4f9d-a5ea-aac03523c578', '6db92596-06e1-42ad-82ba-57ff143c8e9c', 'cf340e16-0962-47bb-8e5c-2201f6fe3951'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:44 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:44 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:44 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.info" returned: 0 in 0.631s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:44 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.405s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:44 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d6abf9e1-bae3-458d-a5c3-f16522dc5535 tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:35:45 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.696s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:45 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Deleted volume successfully. Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-74ede1df-2602-4e62-8ddf-32e54ac4666e tempest-ProjectReaderTests-496383587 None] Lock "cinder-edef8b9a-5ca0-4f28-b29a-ed321b30134a-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-541046fd-1260-4452-969d-daff11441e78-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Lock "cinder-541046fd-1260-4452-969d-daff11441e78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-2eadbbde-ca00-457d-9594-67ec3d21a68a" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-2eadbbde-ca00-457d-9594-67ec3d21a68a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-541046fd-1260-4452-969d-daff11441e78" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-541046fd-1260-4452-969d-daff11441e78" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot 541046fd-1260-4452-969d-daff11441e78 of volume 2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c754796-98be-4ffc-8a50-7b85e5607e2f]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:45 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:45 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 Jul 06 10:35:45 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:46 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78" returned: 0 in 0.827s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:46 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eadbbde-ca00-457d-9594-67ec3d21a68a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:35:46 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[6150a01b-b95a-4ec3-8f3c-d34c910f66af]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:46 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:46 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a Jul 06 10:35:46 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:47 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a" returned: 0 in 0.786s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:47 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:47 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 Jul 06 10:35:47 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:48 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78" returned: 0 in 0.807s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:48 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78 Jul 06 10:35:48 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:48 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:48 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a.541046fd-1260-4452-969d-daff11441e78" returned: 0 in 0.649s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-541046fd-1260-4452-969d-daff11441e78" released by "_delete_snapshot" :: held 3.172s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:48 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-2eadbbde-ca00-457d-9594-67ec3d21a68a" released by "delete_snapshot" :: held 3.194s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:48 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Created reservations ['809ae690-4694-47ed-95c9-9980ca25eeaa', '7f4b1515-9a4a-49c1-ba76-9f60661fef47', '42ead7ec-966b-47f8-ba58-e771f4b78774', '78686043-df6b-475b-89de-d31bf1fa229e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:49 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:35:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-6d6b7e3c-bc95-489b-876c-aef0d9426e0d tempest-ProjectMemberTests-97035211 None] Lock "cinder-541046fd-1260-4452-969d-daff11441e78-delete_snapshot" released by "delete_snapshot" :: held 3.327s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-2eadbbde-ca00-457d-9594-67ec3d21a68a-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:49 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Lock "cinder-2eadbbde-ca00-457d-9594-67ec3d21a68a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:49 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=121,cinder:SELECT=93,cinder:INSERT=34,cinder:DELETE=7 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:35:49 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=95,cinder:UPDATE=116,cinder:DELETE=13,cinder:INSERT=32 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:35:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-2eadbbde-ca00-457d-9594-67ec3d21a68a" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:35:50 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-2eadbbde-ca00-457d-9594-67ec3d21a68a" acquired by "delete_volume" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:35:50 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bac5b0-984a-42f3-8173-20cf4c4df4ef]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:50 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a Jul 06 10:35:50 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:50 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a" returned: 0 in 0.803s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:50 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:50 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a Jul 06 10:35:50 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:51 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-2eadbbde-ca00-457d-9594-67ec3d21a68a" returned: 0 in 0.665s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-2eadbbde-ca00-457d-9594-67ec3d21a68a" released by "delete_volume" :: held 1.531s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Created reservations ['851958de-35b3-448c-bac9-39f4a006b8a1', '94147ee4-6707-4c7a-93fb-fff72c636147', 'fb6e0b41-5726-452f-959f-638d37b63ac9', 'be9e3e7d-1420-4117-bd9a-298ebb4238b6'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:51 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:51 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:51 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:52 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.699s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:52 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-16f3b451-3b08-4a63-9cba-637c45f4005a tempest-ProjectMemberTests-97035211 None] Lock "cinder-2eadbbde-ca00-457d-9594-67ec3d21a68a-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (d99a8766-3852-4bb4-87bf-7ef287eb499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a949ed0-9556-4548-9dca-d678cc398abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a949ed0-9556-4548-9dca-d678cc398abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890516415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bd0813-632d-40f2-b325-47b73d96ea7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:53Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa52db16-9c88-4d3c-85ea-aceefa27888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa52db16-9c88-4d3c-85ea-aceefa27888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f1bd35-7187-495e-9851-1dbcc0bdeeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f1bd35-7187-495e-9851-1dbcc0bdeeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bd0813-632d-40f2-b325-47b73d96ea7b', 'volume_name': 'volume-d4bd0813-632d-40f2-b325-47b73d96ea7b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad79ec4-e2c8-4452-a9ed-c0068cc74c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad79ec4-e2c8-4452-a9ed-c0068cc74c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4800770f-633d-4803-b07b-b3ca3ea2282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:52 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Volume d4bd0813-632d-40f2-b325-47b73d96ea7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bd0813-632d-40f2-b325-47b73d96ea7b', 'volume_size': 1} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1890516415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bd0813-632d-40f2-b325-47b73d96ea7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3abd528895734da3ad1a6fd3d71698af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:53Z,use_quota=True,user_id='ad1fc2ea327c42d299957407d780587b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Creating volume d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:52 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:52 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:52 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b 1073741824 Jul 06 10:35:52 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:53 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b 1073741824" returned: 0 in 0.949s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:53 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:53 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b Jul 06 10:35:53 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:54 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b" returned: 0 in 0.688s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4800770f-633d-4803-b07b-b3ca3ea2282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bd0813-632d-40f2-b325-47b73d96ea7b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42231860-31c6-4461-b0cd-1956f37d0b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:54 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Volume volume-d4bd0813-632d-40f2-b325-47b73d96ea7b (d4bd0813-632d-40f2-b325-47b73d96ea7b): created successfully Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42231860-31c6-4461-b0cd-1956f37d0b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Flow 'volume_create_manager' (d99a8766-3852-4bb4-87bf-7ef287eb499e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:54 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-6a6e10e3-0a58-4b9a-98af-f339deb612c0 tempest-ProjectMemberTests-97035211 None] Created volume successfully. Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Creating offline snapshot 7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 of volume d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c28c510-a1fe-4875-9463-47d340cb0b2c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:35:54 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:55 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b Jul 06 10:35:55 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:55 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b" returned: 0 in 0.777s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:55 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 1G {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:55 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 1G Jul 06 10:35:55 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Flow 'volume_create_manager' (baec7bf4-1089-4dd2-92c9-11c2bd7b0d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2681c707-561b-45b8-a800-1a5251cb9de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2681c707-561b-45b8-a800-1a5251cb9de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434668832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9e8e05-539b-4bb1-beec-54c66ec87226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592bd9f4bb5b401083da7677d82a6db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:56Z,use_quota=True,user_id='a10b86f2c39e41f099470800cc950b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8ff0c4-9e3f-4971-9ac8-57231c760e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8ff0c4-9e3f-4971-9ac8-57231c760e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b917bc5-a727-4333-88a2-dbdc7cd9a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b917bc5-a727-4333-88a2-dbdc7cd9a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9e8e05-539b-4bb1-beec-54c66ec87226', 'volume_name': 'volume-dc9e8e05-539b-4bb1-beec-54c66ec87226', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b99a87-7979-4a96-a4c2-ffbd1cd27d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b99a87-7979-4a96-a4c2-ffbd1cd27d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de21e883-8dfa-4391-9970-123019a06f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:35:56 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Volume dc9e8e05-539b-4bb1-beec-54c66ec87226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9e8e05-539b-4bb1-beec-54c66ec87226', 'volume_size': 1} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:56 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 1G" returned: 0 in 0.816s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:56 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bd0813-632d-40f2-b325-47b73d96ea7b -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:56 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bd0813-632d-40f2-b325-47b73d96ea7b -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 Jul 06 10:35:56 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:57 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4bd0813-632d-40f2-b325-47b73d96ea7b -F qcow2 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" returned: 0 in 0.729s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:57 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 is being set with open permissions: ugo+rw Jul 06 10:35:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:57 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 Jul 06 10:35:57 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:57 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" returned: 0 in 0.619s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:57 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:57 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.info Jul 06 10:35:57 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:58 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.info" returned: 0 in 0.674s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:58 devstack cinder-volume[86456]: WARNING cinder.volume.drivers.remotefs [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.info is being set with open permissions: ugo+rw Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.info {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:58 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.info Jul 06 10:35:58 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:59 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:35:59 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:59 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.info" returned: 0 in 0.698s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.188s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434668832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9e8e05-539b-4bb1-beec-54c66ec87226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592bd9f4bb5b401083da7677d82a6db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:35:56Z,use_quota=True,user_id='a10b86f2c39e41f099470800cc950b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Creating volume dc9e8e05-539b-4bb1-beec-54c66ec87226 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:35:59 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:35:59 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 1073741824 Jul 06 10:35:59 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:35:59 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-197c435a-d0f1-4c3e-bed2-3f0791fbf26d tempest-ProjectMemberTests-97035211 None] Create snapshot completed successfully Jul 06 10:35:59 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.650s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager._thread_info {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread count: 29 {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 10:35:59 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] thread info: [<_MainThread(MainThread, started 128566397079680)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 10:36:00 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 1073741824" returned: 0 in 0.875s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:00 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 Jul 06 10:36:00 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4-delete_snapshot" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Lock "cinder-7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-d4bd0813-632d-40f2-b325-47b73d96ea7b" by "delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-d4bd0813-632d-40f2-b325-47b73d96ea7b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" by "_delete_snapshot" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Deleting offline snapshot 7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 of volume d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] snapshot_file for this snap is: volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 {{(pid=86456) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[489c7977-3e99-4b55-90ef-1049b685a673]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:00 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 Jul 06 10:36:00 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:00 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de21e883-8dfa-4391-9970-123019a06f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9e8e05-539b-4bb1-beec-54c66ec87226', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f9080e-a183-4098-b504-1803fb97e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:00 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Volume volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 (dc9e8e05-539b-4bb1-beec-54c66ec87226): created successfully Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f9080e-a183-4098-b504-1803fb97e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:00 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Flow 'volume_create_manager' (baec7bf4-1089-4dd2-92c9-11c2bd7b0d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:00 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-978bf42e-8d56-473a-a215-4fc226c0c776 tempest-ProjectReaderTests-1614998560 None] Created volume successfully. Jul 06 10:36:01 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" returned: 0 in 0.779s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4bd0813-632d-40f2-b325-47b73d96ea7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86456) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab30f51-2615-4d41-bd13-5df34be6ac52]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:01 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b Jul 06 10:36:01 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Acquiring lock "cinder-dc9e8e05-539b-4bb1-beec-54c66ec87226-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Lock "cinder-dc9e8e05-539b-4bb1-beec-54c66ec87226-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Acquiring lock "cinder-quobyte-dc9e8e05-539b-4bb1-beec-54c66ec87226" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Lock "cinder-quobyte-dc9e8e05-539b-4bb1-beec-54c66ec87226" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f6633-bb50-4811-8ad2-1521cb7ea506]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:01 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 Jul 06 10:36:01 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:01 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b" returned: 0 in 0.815s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:01 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:02 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 Jul 06 10:36:02 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:02 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226" returned: 0 in 0.762s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:02 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226 Jul 06 10:36:02 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:02 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" returned: 0 in 0.789s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:02 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:02 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4 Jul 06 10:36:02 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:03 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-dc9e8e05-539b-4bb1-beec-54c66ec87226" returned: 0 in 0.666s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Lock "cinder-quobyte-dc9e8e05-539b-4bb1-beec-54c66ec87226" released by "delete_volume" :: held 1.479s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Created reservations ['2e91df0c-cd54-43d4-96cd-8c40afbb0e7c', '2abdcc21-9483-40c4-b361-0b8826394272', 'fb4e3d20-a3cc-48e2-a12c-11149d253563', '9ca64d60-16a3-4e84-be1c-96c54e959a82'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:03 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:03 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:03 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b.7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" returned: 0 in 0.669s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4" released by "_delete_snapshot" :: held 3.151s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-d4bd0813-632d-40f2-b325-47b73d96ea7b" released by "delete_snapshot" :: held 3.175s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Created reservations ['5c84c172-c891-4dd9-b397-636ecd09fbf7', '271ed4f7-dea4-40b6-9755-8cd6c1acda3b', 'a1246e29-7c83-4ac4-9a75-8f98b456a1ff', '9a9ecbd8-63c5-4d1c-92fa-dfdd9d292d5e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Delete snapshot completed successfully. Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-e88ca689-6559-43b0-aed6-b33af0fd6eea tempest-ProjectMemberTests-97035211 None] Lock "cinder-7a15cd33-8d1f-4142-b5e4-28df7ad5b4d4-delete_snapshot" released by "delete_snapshot" :: held 3.333s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:03 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.664s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:36:03 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Deleted volume successfully. Jul 06 10:36:03 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-facc84bb-543f-4908-98e5-3bb682b24b6e tempest-ProjectReaderTests-1614998560 None] Lock "cinder-dc9e8e05-539b-4bb1-beec-54c66ec87226-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Flow 'volume_create_manager' (22926838-94c6-4a9a-83bc-3e8403c6d7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e575d7a5-1936-4b86-9337-e14d2bbb144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e575d7a5-1936-4b86-9337-e14d2bbb144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142373143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bf8a99-584f-4e7b-a4d2-1f5296686a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592bd9f4bb5b401083da7677d82a6db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:04Z,use_quota=True,user_id='a10b86f2c39e41f099470800cc950b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6bbdc4-3433-48c4-b384-e6a3f015f950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6bbdc4-3433-48c4-b384-e6a3f015f950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40a912f-b2e9-40bd-a35d-a277ee3aafb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40a912f-b2e9-40bd-a35d-a277ee3aafb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48bf8a99-584f-4e7b-a4d2-1f5296686a28', 'volume_name': 'volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80042e1-82d2-4284-b5a1-2a766948fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d80042e1-82d2-4284-b5a1-2a766948fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7734d1ec-03c6-41f2-8c08-3a1f3c1a1502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:04 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Volume 48bf8a99-584f-4e7b-a4d2-1f5296686a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28', 'volume_size': 1} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142373143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bf8a99-584f-4e7b-a4d2-1f5296686a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='592bd9f4bb5b401083da7677d82a6db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:04Z,use_quota=True,user_id='a10b86f2c39e41f099470800cc950b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Creating volume 48bf8a99-584f-4e7b-a4d2-1f5296686a28 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:36:04 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:04 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 1073741824 Jul 06 10:36:04 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-d4bd0813-632d-40f2-b325-47b73d96ea7b-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Lock "cinder-d4bd0813-632d-40f2-b325-47b73d96ea7b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Acquiring lock "cinder-quobyte-d4bd0813-632d-40f2-b325-47b73d96ea7b" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-d4bd0813-632d-40f2-b325-47b73d96ea7b" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[28792d0a-810b-4794-81c8-781508fa4f8c]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:04 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:04 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b Jul 06 10:36:04 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:05 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 1073741824" returned: 0 in 0.872s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:05 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 Jul 06 10:36:05 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:05 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b" returned: 0 in 0.801s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:05 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b Jul 06 10:36:05 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:05 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28" returned: 0 in 0.689s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7734d1ec-03c6-41f2-8c08-3a1f3c1a1502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc65955-0a7c-46f9-9058-d7daa68da773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:05 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Volume volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 (48bf8a99-584f-4e7b-a4d2-1f5296686a28): created successfully Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc65955-0a7c-46f9-9058-d7daa68da773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:05 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Flow 'volume_create_manager' (22926838-94c6-4a9a-83bc-3e8403c6d7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:05 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-5dbf3113-00a5-4427-8e32-19a6ec8a1a1e tempest-ProjectReaderTests-1614998560 None] Created volume successfully. Jul 06 10:36:06 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-d4bd0813-632d-40f2-b325-47b73d96ea7b" returned: 0 in 0.656s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Lock "cinder-quobyte-d4bd0813-632d-40f2-b325-47b73d96ea7b" released by "delete_volume" :: held 1.523s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Created reservations ['9292218d-a562-45a5-9195-b666532377ee', 'f79110e8-ac19-4180-b5a5-c21f80e5f852', 'b10f6c69-00e9-4b44-b368-217f93019089', 'd066a678-0a3e-472a-86cf-36f7ac89c55a'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:06 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:06 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Acquiring lock "cinder-48bf8a99-584f-4e7b-a4d2-1f5296686a28-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Lock "cinder-48bf8a99-584f-4e7b-a4d2-1f5296686a28-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Acquiring lock "cinder-quobyte-48bf8a99-584f-4e7b-a4d2-1f5296686a28" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Lock "cinder-quobyte-48bf8a99-584f-4e7b-a4d2-1f5296686a28" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3fe925-35cb-4626-b32a-fd456961e323]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:06 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 Jul 06 10:36:06 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:06 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.664s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:36:06 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Deleted volume successfully. Jul 06 10:36:06 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-489a212e-8e7e-4886-a64d-cdaf72e5b65d tempest-ProjectMemberTests-97035211 None] Lock "cinder-d4bd0813-632d-40f2-b325-47b73d96ea7b-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:07 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28" returned: 0 in 0.789s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:07 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28 Jul 06 10:36:07 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:07 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:07 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-48bf8a99-584f-4e7b-a4d2-1f5296686a28" returned: 0 in 0.710s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:07 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Lock "cinder-quobyte-48bf8a99-584f-4e7b-a4d2-1f5296686a28" released by "delete_volume" :: held 1.549s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Created reservations ['ecf5a51c-abd9-4eaa-940e-6cb1d30e6e96', 'b5911707-f88e-418e-bc56-af544fd9a8b5', '8c88b053-45a3-48f8-a323-c75d375cf729', '352b26a6-800e-4229-a53d-8c09149f7d5f'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:08 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:08 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:08 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.713s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:36:08 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Deleted volume successfully. Jul 06 10:36:08 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-9ef552c1-a8be-46c2-ac2a-14bdc8cd4f24 tempest-ProjectReaderTests-1614998560 None] Lock "cinder-48bf8a99-584f-4e7b-a4d2-1f5296686a28-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:18 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=39,cinder:INSERT=13,cinder:UPDATE=50,cinder:DELETE=3 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:36:18 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=46,cinder:SELECT=26,cinder:INSERT=11,cinder:DELETE=5 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (43e540d8-6381-4792-8c14-37de895d3b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f5c97d-a502-4d7c-96fd-6dd3c47c0850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f5c97d-a502-4d7c-96fd-6dd3c47c0850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397220352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67897fa2-c2b2-4920-972c-eab75b2ee40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:23Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81276ac1-894d-4bb3-8bfc-ec03c8c8598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81276ac1-894d-4bb3-8bfc-ec03c8c8598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6e65cf-6097-4d07-abd8-cdb09a1e4fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6e65cf-6097-4d07-abd8-cdb09a1e4fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67897fa2-c2b2-4920-972c-eab75b2ee40c', 'volume_name': 'volume-67897fa2-c2b2-4920-972c-eab75b2ee40c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b0ad26-bd42-4224-99d3-f3507ddd1488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b0ad26-bd42-4224-99d3-f3507ddd1488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c442b87c-3bb5-47aa-b79b-50ca44d2a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:23 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Volume 67897fa2-c2b2-4920-972c-eab75b2ee40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67897fa2-c2b2-4920-972c-eab75b2ee40c', 'volume_size': 1} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1397220352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67897fa2-c2b2-4920-972c-eab75b2ee40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:23Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Creating volume 67897fa2-c2b2-4920-972c-eab75b2ee40c {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:36:23 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:36:23 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:23 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c 1073741824 Jul 06 10:36:23 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:24 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c 1073741824" returned: 0 in 0.869s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:24 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c Jul 06 10:36:24 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:24 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c" returned: 0 in 0.617s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c442b87c-3bb5-47aa-b79b-50ca44d2a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67897fa2-c2b2-4920-972c-eab75b2ee40c', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1c370d-7344-47ec-a016-6db54b6c72be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:24 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Volume volume-67897fa2-c2b2-4920-972c-eab75b2ee40c (67897fa2-c2b2-4920-972c-eab75b2ee40c): created successfully Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1c370d-7344-47ec-a016-6db54b6c72be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:24 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (43e540d8-6381-4792-8c14-37de895d3b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:24 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3f098272-bd0b-4de7-88a2-3f3d6178d8b9 tempest-ProjectReaderTests-1882078341 None] Created volume successfully. Jul 06 10:36:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-67897fa2-c2b2-4920-972c-eab75b2ee40c-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Lock "cinder-67897fa2-c2b2-4920-972c-eab75b2ee40c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-quobyte-67897fa2-c2b2-4920-972c-eab75b2ee40c" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:25 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-67897fa2-c2b2-4920-972c-eab75b2ee40c" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:25 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a5d938-a99b-4f13-81f1-c0a2d8195d60]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:25 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:25 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c Jul 06 10:36:25 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:26 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c" returned: 0 in 0.816s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:26 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c Jul 06 10:36:26 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:26 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-67897fa2-c2b2-4920-972c-eab75b2ee40c" returned: 0 in 0.627s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-67897fa2-c2b2-4920-972c-eab75b2ee40c" released by "delete_volume" :: held 1.486s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Created reservations ['f3fcc0cc-c5ff-4371-873c-dd2f97ebbebf', '2f573e91-3d69-4a38-9f6c-fa8092f7de63', '6ed2830d-79b8-4bc9-9293-769105b4e7f1', '521719ca-d245-4722-8866-90086bbe2585'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:26 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:26 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:26 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:27 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.711s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:36:27 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Deleted volume successfully. Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-b3e6482a-eb5f-4ad8-97f3-97853d8b449f tempest-ProjectReaderTests-1882078341 None] Lock "cinder-67897fa2-c2b2-4920-972c-eab75b2ee40c-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (70a2f5e0-b5f2-47bb-a23c-46c107b3bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3441790-d5f7-4fee-bfbf-b9bac875315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3441790-d5f7-4fee-bfbf-b9bac875315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660197640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7e21af-e5ae-4fa1-884b-289b78b06cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:28Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d2ff9-0f16-4998-a188-d8c7c57f229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d2ff9-0f16-4998-a188-d8c7c57f229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864ec63c-2ede-4bd0-8947-7875f0248575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864ec63c-2ede-4bd0-8947-7875f0248575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7e21af-e5ae-4fa1-884b-289b78b06cb4', 'volume_name': 'volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaabb94-fc78-4f41-9656-b39686ed30c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:27 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaabb94-fc78-4f41-9656-b39686ed30c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd2bc23-8c08-4f88-8a67-92f15f2c1c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:28 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Volume ed7e21af-e5ae-4fa1-884b-289b78b06cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4', 'volume_size': 1} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1660197640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7e21af-e5ae-4fa1-884b-289b78b06cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:28Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Creating volume ed7e21af-e5ae-4fa1-884b-289b78b06cb4 {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:36:28 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:28 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 1073741824 Jul 06 10:36:28 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:28 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 1073741824" returned: 0 in 0.787s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:28 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:28 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 Jul 06 10:36:28 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:29 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4" returned: 0 in 0.674s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:29 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:36:29 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd2bc23-8c08-4f88-8a67-92f15f2c1c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15eb470a-1066-4314-9b32-bebcba28481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:29 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Volume volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 (ed7e21af-e5ae-4fa1-884b-289b78b06cb4): created successfully Jul 06 10:36:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15eb470a-1066-4314-9b32-bebcba28481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:29 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (70a2f5e0-b5f2-47bb-a23c-46c107b3bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:29 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-0fa2f36a-6f98-46ea-89c1-ca93489cf6dc tempest-ProjectReaderTests-1882078341 None] Created volume successfully. Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-ed7e21af-e5ae-4fa1-884b-289b78b06cb4-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Lock "cinder-ed7e21af-e5ae-4fa1-884b-289b78b06cb4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-quobyte-ed7e21af-e5ae-4fa1-884b-289b78b06cb4" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-ed7e21af-e5ae-4fa1-884b-289b78b06cb4" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefba781-15f6-4ade-b0f3-ebce2c0c2f92]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:30 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 Jul 06 10:36:30 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:30 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4" returned: 0 in 0.801s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:30 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:30 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4 Jul 06 10:36:30 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:31 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-ed7e21af-e5ae-4fa1-884b-289b78b06cb4" returned: 0 in 0.623s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-ed7e21af-e5ae-4fa1-884b-289b78b06cb4" released by "delete_volume" :: held 1.459s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Created reservations ['0a1f5ca2-d607-4686-a220-a409723b47c4', '853f4669-17c5-4b7a-bf29-b69cbc5fe021', '5495522b-b126-4b2c-838a-caeeb6191494', '240f35c7-f65d-431b-821c-112306f47b2e'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:31 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:31 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:31 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:32 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.624s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:36:32 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Deleted volume successfully. Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-2c46fbcd-1e6b-4278-bdc3-dba8343dafaf tempest-ProjectReaderTests-1882078341 None] Lock "cinder-ed7e21af-e5ae-4fa1-884b-289b78b06cb4-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (3a7b6337-8213-4767-b545-8068e090beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3d1337-7f87-466a-88be-1a421b0bbbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af3d1337-7f87-466a-88be-1a421b0bbbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888798312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cddeaa-011a-4787-978f-41c6bd338d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:33Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6273f25f-68c1-46d8-9fee-334ee1905243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6273f25f-68c1-46d8-9fee-334ee1905243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1eeeb2-01c3-4005-bb9c-e2b6df623ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1eeeb2-01c3-4005-bb9c-e2b6df623ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7cddeaa-011a-4787-978f-41c6bd338d5b', 'volume_name': 'volume-a7cddeaa-011a-4787-978f-41c6bd338d5b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766ca644-16ba-44d6-9d1c-a56241065cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766ca644-16ba-44d6-9d1c-a56241065cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e944a5-b4ba-432d-8908-070e0964200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:32 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Volume a7cddeaa-011a-4787-978f-41c6bd338d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7cddeaa-011a-4787-978f-41c6bd338d5b', 'volume_size': 1} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-888798312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7cddeaa-011a-4787-978f-41c6bd338d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:33Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Creating volume a7cddeaa-011a-4787-978f-41c6bd338d5b {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:36:32 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:36:32 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:32 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b 1073741824 Jul 06 10:36:32 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:33 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b 1073741824" returned: 0 in 0.755s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:33 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:33 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b Jul 06 10:36:33 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:34 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b" returned: 0 in 0.605s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e944a5-b4ba-432d-8908-070e0964200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7cddeaa-011a-4787-978f-41c6bd338d5b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c708db80-9cd2-41c4-9a23-67cd203665d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:34 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Volume volume-a7cddeaa-011a-4787-978f-41c6bd338d5b (a7cddeaa-011a-4787-978f-41c6bd338d5b): created successfully Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c708db80-9cd2-41c4-9a23-67cd203665d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (3a7b6337-8213-4767-b545-8068e090beb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:34 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-872cf443-139d-4a4f-96c7-e0a96b85944b tempest-ProjectReaderTests-1882078341 None] Created volume successfully. Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-a7cddeaa-011a-4787-978f-41c6bd338d5b-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Lock "cinder-a7cddeaa-011a-4787-978f-41c6bd338d5b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-quobyte-a7cddeaa-011a-4787-978f-41c6bd338d5b" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-a7cddeaa-011a-4787-978f-41c6bd338d5b" acquired by "delete_volume" :: waited 0.014s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f36633-caa6-4d38-a436-9f7b467bd6a3]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:34 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:34 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b Jul 06 10:36:34 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:35 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b" returned: 0 in 0.719s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:35 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:35 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b Jul 06 10:36:35 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:36 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a7cddeaa-011a-4787-978f-41c6bd338d5b" returned: 0 in 0.620s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-a7cddeaa-011a-4787-978f-41c6bd338d5b" released by "delete_volume" :: held 1.374s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Created reservations ['1c1f0c2a-736e-4de2-971f-3463bf0daf8a', '03fc0bf2-16e1-4658-9190-15f83b2ac815', '052ad8a5-9dff-459f-9f7d-82c721c99846', 'aaf365d0-4aed-4ebc-a5ac-1f1f0ce737ad'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:36 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:36 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:36 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.620s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:36:36 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Deleted volume successfully. Jul 06 10:36:36 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-831ca9fd-4748-42b1-b221-74c462ceb7bb tempest-ProjectReaderTests-1882078341 None] Lock "cinder-a7cddeaa-011a-4787-978f-41c6bd338d5b-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86456) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (96d72031-6144-43e0-b372-c8c90efdd65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e15a0f-5822-4c48-bda1-3317c2c8fd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e15a0f-5822-4c48-bda1-3317c2c8fd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350933190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e3a8ad-5263-4c71-81ff-32ac4d7b011b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:37Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f977ad-2786-4905-8d54-84bd0e76be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f977ad-2786-4905-8d54-84bd0e76be98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28ce5d2-ef5a-4730-b8b2-6e755dbd870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28ce5d2-ef5a-4730-b8b2-6e755dbd870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e3a8ad-5263-4c71-81ff-32ac4d7b011b', 'volume_name': 'volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760f4316-ac68-4e90-b4e3-bb938bdb455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760f4316-ac68-4e90-b4e3-bb938bdb455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556831bb-0c02-42ed-8853-5fcdb1400ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:37 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Volume a1e3a8ad-5263-4c71-81ff-32ac4d7b011b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b', 'volume_size': 1} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T08:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350933190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e3a8ad-5263-4c71-81ff-32ac4d7b011b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd60e17fcee741cabc12d8e11ecdfc5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T08:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T08:36:37Z,use_quota=True,user_id='6960d84663cf4dc7bf7b5a8a5f525560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21887a4e-d86c-48df-b3ea-cfb2da3f7b06),volume_type_id=21887a4e-d86c-48df-b3ea-cfb2da3f7b06)}" {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.remotefs [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Creating volume a1e3a8ad-5263-4c71-81ff-32ac4d7b011b {{(pid=86456) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Selected osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba as target Quobyte volume. {{(pid=86456) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 10:36:37 devstack cinder-volume[86456]: INFO cinder.volume.drivers.remotefs [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] casted to osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba Jul 06 10:36:37 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b 1073741824 {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:37 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b 1073741824 Jul 06 10:36:37 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:38 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b 1073741824" returned: 0 in 0.792s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:38 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b Jul 06 10:36:38 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:38 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b" returned: 0 in 0.618s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'} {{(pid=86456) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556831bb-0c02-42ed-8853-5fcdb1400ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b', 'volume_size': 1}' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ff51f7-4cd1-4232-8ba7-6f4d1dbb139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 10:36:38 devstack cinder-volume[86456]: INFO cinder.volume.flows.manager.create_volume [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Volume volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b (a1e3a8ad-5263-4c71-81ff-32ac4d7b011b): created successfully Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ff51f7-4cd1-4232-8ba7-6f4d1dbb139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86456) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 10:36:38 devstack cinder-volume[86456]: DEBUG cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Flow 'volume_create_manager' (96d72031-6144-43e0-b372-c8c90efdd65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86456) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 10:36:38 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-3f18ec58-2a64-427a-87f2-05baf0dd59e0 tempest-ProjectReaderTests-1882078341 None] Created volume successfully. Jul 06 10:36:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b-delete_volume" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Lock "cinder-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Acquiring lock "cinder-quobyte-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b" by "delete_volume" {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 10:36:39 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b" acquired by "delete_volume" :: waited 0.015s {{(pid=86456) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 10:36:39 devstack cinder-volume[86456]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a6970-0c6a-4bfb-b55a-941fcb568993]: (4, 'qcow2') {{(pid=87116) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 10:36:39 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:39 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b Jul 06 10:36:39 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:40 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b" returned: 0 in 0.716s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:40 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b Jul 06 10:36:40 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:40 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:40 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe/volume-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b" returned: 0 in 0.610s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:40 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Lock "cinder-quobyte-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b" released by "delete_volume" :: held 1.361s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:40 devstack cinder-volume[86456]: DEBUG cinder.quota [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Created reservations ['d1f0fb91-6980-4e7c-b0a1-6c8c56e5d3ae', '2533d5cf-0e65-472e-b670-6e13538c863a', 'ed67397a-6d70-49d5-b50c-e3c1d478c27e', '2e69e878-291b-4875-8fe7-1c7542299b36'] {{(pid=86456) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:41 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:41 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 10:36:41 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe" returned: 0 in 0.611s {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG cinder.manager [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Notifying Schedulers of capabilities ... {{(pid=86456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 10:36:41 devstack cinder-volume[86456]: INFO cinder.volume.manager [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Deleted volume successfully. Jul 06 10:36:41 devstack cinder-volume[86456]: DEBUG cinder.coordination [None req-d157e485-e420-472f-bd4a-ed6f5e5bc9d0 tempest-ProjectReaderTests-1882078341 None] Lock "cinder-a1e3a8ad-5263-4c71-81ff-32ac4d7b011b-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=86456) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 10:36:51 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:UPDATE=50,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=13 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:36:51 devstack cinder-volume[86456]: DEBUG dbcounter [-] [86456] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=38,cinder:DELETE=6 {{(pid=86456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 10:36:58 devstack cinder-volume[86456]: DEBUG oslo_service.periodic_task [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 10:36:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 10:36:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 10:36:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba': None} {{(pid=86456) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 10:36:58 devstack cinder-volume[86456]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dedafeec-2488-42a1-b8ed-a1c675f0fcba'] {{(pid=86456) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 10:36:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.lockutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86456) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 10:36:58 devstack cinder-volume[86456]: DEBUG oslo_concurrency.processutils [None req-1d1c1be5-77e9-41c4-a366-a9e041d9c838 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe {{(pid=86456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 10:36:59 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/dcb324c987fd72ed1af58f995ea38dfe Jul 06 10:36:59 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)